Description of problem: migration of large sql table has data losses Version-Release number of selected component (if applicable): jenkins build 188 How reproducible: always Steps to Reproduce: 1. run migrator jar against sql table having > 900 000 rows (my data -- 983990) 2. 3. Actual results: migrated only 714416 Expected results: all data should be migrated Additional info: when there are few data (my data -- 369635) migration worked correctly - all the data was migrated from postgres to cassandra
Updated all the queries to avoid any potential overlap between them. Please retest.
reopening jenkins build with logs here-> http://jenkins.jonqe.lab.eng.bos.redhat.com:9080/job/Migrator_Run/30/console
Got the following error from the SQL host you are using for tests: 198232 [Thread-5] ERROR org.hibernate.engine.jdbc.spi.SqlExceptionHelper - ERROR: could not write block 1 of temporary file: No space left on device Hint: Perhaps out of disk space? Please make sure there is enough space on the disk....
verified. created an env with 8gb ram and 20 gb disk space - migration passing with no exception.
reopned retested with 4gb ram 30db disk space (25% of overall disk space is used) - migration fails for 10 mln rows from postgresql --> http://jenkins.jonqe.lab.eng.bos.redhat.com:9080/job/Migrator_Run/47/console
Created attachment 748359 [details] top-beforeMigration
Created attachment 748360 [details] top-duringMigration
When migration for large data (>68 mln rows in postgres) starts - postgres takes 98% CPU usage (16 gb ram 50 gb disk size) and migration fails with could not extract ResultSet exception. please have a look into logs in jenkins -> http://jenkins.jonqe.lab.eng.bos.redhat.com:9080/job/Migrator_Run/55/console
The log show that the estimation process was causing the timeout. Added a few more updates to the increase the timeout for count queries.
When migration for large data (>68 mln rows in postgres) starts - postgres takes 98% CPU usage (16 gb ram 50 gb disk size) and migration fails with could not extract ResultSet exception. please have a look into logs in jenkins -> http://jenkins.jonqe.lab.eng.bos.redhat.com:9080/job/Migrator_Run/ 61 & 62 builds. migrator jar from rhq-cassandra jenkins build 228.
This is an environmental issue due to insufficient disk space for the data. Please increase the disk space and try again the test case. The amount of new data created by migration will be comparable to the existing SQL data. Please expand the disk accordingly.
verified. For details please have a look into Migration Run jenkins build 82.