Red Hat Bugzilla – Bug 970136
No space left on device error after several restarts
Last modified: 2014-02-18 18:56:52 EST
Description of problem:
Restarting httpd several times in VM leads to No space left on device message in error log and httpd refuses to start
Version-Release number of selected component (if applicable):
Always (after couple of tries)
Steps to Reproduce:
1. Schedule /CoreOs/httpd/Sanity/bz874479-Support-SSLCompression-on-in several times in one recipeset
2. Watch it fails after about 4th try
[Mon Jun 03 15:36:30.127818 2013] [core:notice] [pid 10499] SELinux policy enabled; httpd running as context unconfined_u:system_r:unconfined
[Mon Jun 03 15:36:30.128428 2013] [suexec:notice] [pid 10499] AH01232: suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
[Mon Jun 03 15:36:31.001252 2013] [ssl:notice] [pid 10499] AH01886: SSL FIPS mode disabled
[Mon Jun 03 15:36:31.057056 2013] [auth_digest:notice] [pid 10500] AH01757: generating secret for digest authentication ...
[Mon Jun 03 15:36:31.057517 2013] [core:emerg] [pid 10500] (28)No space left on device: AH00023: Couldn't create the authdigest-opaque mutex
[Mon Jun 03 15:36:31.057551 2013] [auth_digest:error] [pid 10500] (28)No space left on device: AH01760: failed to create lock (opaque_lock) -
[Mon Jun 03 15:36:31.057620 2013] [:emerg] [pid 10500] AH00020: Configuration Failed, exiting
Simple reboot fixes issue.
There's plenty of space on all volumes.
I'm investigating now if I can reproduce this more simply.
# while true; do killall -9 httpd; httpd; sleep 1; done
can cause this.
Terminating the httpd parent with SIGKILL is expected to have this effect, SysV semaphores and shm segments cannot be cleaned up reliably if the parent is terminated "with extreme prejudice"...
However this should not be seen during normal operation. We have been adjusting systemd shutdown handling so this could be a side-effect.
Put the env vars in /etc/sysconfig/httpd
If this is intended behaviour, feel free to close this bug, my issue is solved.
Thanks Lukas. Yes, done.