Bug 851756

Summary: mysql keeps restarting
Product: OKD Reporter: simon
Component: ContainersAssignee: Ram Ranganathan <ramr>
Status: CLOSED INSUFFICIENT_DATA QA Contact: libra bugs <libra-bugs>
Severity: low Docs Contact:
Priority: medium    
Version: 2.xCC: mfisher, mpatel
Target Milestone: ---Flags: ramr: needinfo+
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2012-10-04 12:17:23 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description simon 2012-08-25 09:45:43 UTC
similarly to " mysql shuts itself down approx every 24 hrs" https://bugzilla.redhat.com/show_bug.cgi?id=842977

But my restarts happen less regularly. Ususally every 1-3 hours but sometimes as often as every 10min!

Last two days:

120823  1:28:28 [Note] /usr/libexec/mysqld: Shutdown complete
120823  2:39:32 [Note] /usr/libexec/mysqld: Shutdown complete
120823  2:52:09 [Note] /usr/libexec/mysqld: Shutdown complete
120823  3:03:44 [Note] /usr/libexec/mysqld: Shutdown complete
120823  4:41:49 [Note] /usr/libexec/mysqld: Shutdown complete
120823  5:36:11 [Note] /usr/libexec/mysqld: Shutdown complete
120823  5:51:56 [Note] /usr/libexec/mysqld: Shutdown complete
120823  6:59:54 [Note] /usr/libexec/mysqld: Shutdown complete
120823  7:26:11 [Note] /usr/libexec/mysqld: Shutdown complete
120823  9:18:55 [Note] /usr/libexec/mysqld: Shutdown complete
120823 10:21:53 [Note] /usr/libexec/mysqld: Shutdown complete
120823 12:20:33 [Note] /usr/libexec/mysqld: Shutdown complete
120823 13:09:58 [Note] /usr/libexec/mysqld: Shutdown complete
120823 13:22:40 [Note] /usr/libexec/mysqld: Shutdown complete
120823 14:13:00 [Note] /usr/libexec/mysqld: Shutdown complete
120823 15:17:03 [Note] /usr/libexec/mysqld: Shutdown complete
120823 16:02:18 [Note] /usr/libexec/mysqld: Shutdown complete
120823 17:07:36 [Note] /usr/libexec/mysqld: Shutdown complete
120823 17:47:25 [Note] /usr/libexec/mysqld: Shutdown complete
120823 18:20:58 [Note] /usr/libexec/mysqld: Shutdown complete
120823 18:53:35 [Note] /usr/libexec/mysqld: Shutdown complete
120823 23:02:53 [Note] /usr/libexec/mysqld: Shutdown complete
120823 23:50:18 [Note] /usr/libexec/mysqld: Shutdown complete
120824  1:55:28 [Note] /usr/libexec/mysqld: Shutdown complete
120824  2:20:46 [Note] /usr/libexec/mysqld: Shutdown complete
120824  3:55:08 [Note] /usr/libexec/mysqld: Shutdown complete
120824  4:20:24 [Note] /usr/libexec/mysqld: Shutdown complete
120824  4:33:04 [Note] /usr/libexec/mysqld: Shutdown complete
120824  6:19:58 [Note] /usr/libexec/mysqld: Shutdown complete
120824  6:42:05 [Note] /usr/libexec/mysqld: Shutdown complete
120824  7:19:54 [Note] /usr/libexec/mysqld: Shutdown complete
120824  8:11:24 [Note] /usr/libexec/mysqld: Shutdown complete
120824  8:25:09 [Note] /usr/libexec/mysqld: Shutdown complete
120824  8:56:52 [Note] /usr/libexec/mysqld: Shutdown complete
120824  9:41:24 [Note] /usr/libexec/mysqld: Shutdown complete
120824 10:14:57 [Note] /usr/libexec/mysqld: Shutdown complete
120824 11:15:46 [Note] /usr/libexec/mysqld: Shutdown complete
120824 11:29:33 [Note] /usr/libexec/mysqld: Shutdown complete
120824 11:29:41 [Note] /usr/libexec/mysqld: Shutdown complete
120824 12:11:56 [Note] /usr/libexec/mysqld: Shutdown complete
120824 13:34:11 [Note] /usr/libexec/mysqld: Shutdown complete
120824 14:41:35 [Note] /usr/libexec/mysqld: Shutdown complete
120824 15:31:06 [Note] /usr/libexec/mysqld: Shutdown complete
120824 18:34:07 [Note] /usr/libexec/mysqld: Shutdown complete
120824 19:30:53 [Note] /usr/libexec/mysqld: Shutdown complete
120824 19:31:01 [Note] /usr/libexec/mysqld: Shutdown complete
120824 20:01:38 [Note] /usr/libexec/mysqld: Shutdown complete
120824 20:12:18 [Note] /usr/libexec/mysqld: Shutdown complete
120824 20:22:55 [Note] /usr/libexec/mysqld: Shutdown complete

Comment 1 simon 2012-08-27 18:00:17 UTC
A JDBC ORM is running with much load.

Comment 2 Ram Ranganathan 2012-08-27 23:00:19 UTC
@simon,  is this a scalable app -- meaning is mysql running on a dedicated gear? 
If so, can you try removing and adding mysql back to your application. See if that helps??  
You might also want to take a snapshot of your app's data before you remove the mysql cartridge -- can do that via either:   
      rhc app snapshot -a $app
 or then sshing into your mysql gear via running something like:  
      mysqldump --password=$OPENSHIFT_DB_PASSWORD -h $OPENSHIFT_DB_HOST \
                        -P $OPENSHIFT_DB_PORT -u $OPENSHIFT_DB_NAME --all-databases \
                        --add-drop-table > $OPENSHIFT_DATA_DIR/alldbs.sql

And copy that alldbs.sql file down to your machine.

Make sure, you have your data in that gzipped tarball/sql file.  

If its not a scalable app, meaning mysql and the app server are running on the same gear - try pinging your app (http://$app-$ns.rhcloud.com) -- we do idle gears (if your app's running on it and is not accessed).   

Thanks,

Ram//

Comment 3 Ram Ranganathan 2012-10-04 05:58:07 UTC
@simon, haven't heard back from you. Based on your comment, this looks to 
be resource issue  (possibly memory related). 

Can you please reply - otherwise will assume all is well and close this
bugz out as it works fine for me.

Comment 4 simon 2012-10-04 12:17:23 UTC
sorry, i moved the up back to my server.

could very well be a memory problem because it is using a lot.