Bug 914737
| Summary: | Fedora 18 on EC2 kernel panic due to cgroups | |||
|---|---|---|---|---|
| Product: | [Fedora] Fedora | Reporter: | Krishna Raman <kraman> | |
| Component: | kernel | Assignee: | Kernel Maintainer List <kernel-maint> | |
| Status: | CLOSED ERRATA | QA Contact: | Fedora Extras Quality Assurance <extras-qa> | |
| Severity: | unspecified | Docs Contact: | ||
| Priority: | unspecified | |||
| Version: | 18 | CC: | bfan, drjones, gansalmon, itamar, jforbes, jonathan, kernel-maint, ketuzsezr, leiwang, madhu.chinakonda, mattdm, mfisher, moli, qguan, wshi | |
| Target Milestone: | --- | |||
| Target Release: | --- | |||
| Hardware: | Unspecified | |||
| OS: | Linux | |||
| Whiteboard: | ||||
| Fixed In Version: | Doc Type: | Bug Fix | ||
| Doc Text: | Story Points: | --- | ||
| Clone Of: | ||||
| : | 955646 (view as bug list) | Environment: | ||
| Last Closed: | 2013-03-22 00:17:36 UTC | Type: | Bug | |
| Regression: | --- | Mount Type: | --- | |
| Documentation: | --- | CRM: | ||
| Verified Versions: | Category: | --- | ||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | ||
| Cloudforms Team: | --- | Target Upstream Version: | ||
| Embargoed: | ||||
| Bug Depends On: | ||||
| Bug Blocks: | 955646 | |||
|
Description
Krishna Raman
2013-02-22 16:31:22 UTC
I have noticed similar crashes with F17 as well Is this reproducing with the current 3.7 kernels in F17 and F18? There were a number of fixes since 3.6.10 Konrad, have you seen anything like this oops before? Hm. Looks like someone hit this in Ubuntu with 3.5: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1073238/ and someone reported on the systemd-devel list (??) that it showed up in 3.3 with the memcfg rewrite: http://lists.freedesktop.org/archives/systemd-devel/2012-December/007826.html Same guy, reported to the cgroups list: http://thread.gmane.org/gmane.linux.kernel.cgroups/5540 thread went nowhere. Oh, hey. Spiffy. Konrad _has_ seen this: https://lkml.org/lkml/2013/2/21/271 I am running 3.6.10-4.fc18.x86_64 on a m1.large machine which is under some pretty heavy load. I do not see kernel 3.7 in updates or updates-testing repo. Will be glad to try 3.7 if you think it will help. (In reply to comment #7) > I am running 3.6.10-4.fc18.x86_64 on a m1.large machine which is under some > pretty heavy load. I do not see kernel 3.7 in updates or updates-testing > repo. That's pretty baffling. What happens when you run 'yum update' on your machine? Are the update repos configured and enabled? We've had the 3.7 kernel in F18 updates since the initial GA. The latest one in F18 stable is 3.7.9. http://mirrors.kernel.org/fedora//updates/18/x86_64/kernel-3.7.9-201.fc18.x86_64.rpm > Will be glad to try 3.7 if you think it will help. It probably won't immediately, but when this gets fixed it will go out in a normal kernel update for Fedora, which will be 3.7 (or 3.8) based. So figuring out why you can't see updates now would be good. Krishna, please test this scratch build when it finishes building. It contains the patch I've linked to. http://koji.fedoraproject.org/koji/taskinfo?taskID=5053087 I tried this against my code today and did not run into any kernel panics so looks like this kernel is a lot more stable. Is this change going to make it into fedora updates? (In reply to comment #9) > Krishna, please test this scratch build when it finishes building. It > contains the patch I've linked to. > > http://koji.fedoraproject.org/koji/taskinfo?taskID=5053087 (In reply to comment #10) > I tried this against my code today and did not run into any kernel panics so > looks like this kernel is a lot more stable. Is this change going to make it > into fedora updates? Yes. I'll get it in today. Committed to all active Fedora branches. Bodhi will leave the usual comments when it shows up in the updates repositories. Krishna, Is it OK to put Tested-by: Krishna Raman <kraman> on the patch (need to resubmit to hpa or ingo). (In reply to comment #13) > Krishna, > > Is it OK to put Tested-by: Krishna Raman <kraman> on the patch > (need to resubmit to hpa or ingo). Yep, should be fine. Ive tested a bunch of OpenShift builds on it now and have not seen any more failures. kernel-3.7.10-101.fc17 has been submitted as an update for Fedora 17. https://admin.fedoraproject.org/updates/kernel-3.7.10-101.fc17 Krishna, the upstream kernel developers came up with an additional patch in this area that patches out the function calls when running on bare metal. I've grabbed that and included it in the scratch build below: http://koji.fedoraproject.org/koji/taskinfo?taskID=5066692 it would be very appreciated if you could test that in your environment to make sure it's working as expected. I'll test on bare metal here. Thanks. Will test it out over the weekend Package kernel-3.7.10-101.fc17: * should fix your issue, * was pushed to the Fedora 17 testing repository, * should be available at your local mirror within two days. Update it with: # su -c 'yum update --enablerepo=updates-testing kernel-3.7.10-101.fc17' as soon as you are able to, then reboot. Please go to the following url: https://admin.fedoraproject.org/updates/FEDORA-2013-3252/kernel-3.7.10-101.fc17 then log in and leave karma (feedback). kernel-3.8.2-105.fc17 has been submitted as an update for Fedora 17. https://admin.fedoraproject.org/updates/kernel-3.8.2-105.fc17 (In reply to comment #17) > Thanks. Will test it out over the weekend Did you ever get a chance to test the kernel build out? Upstream is looking for feedback. (In reply to comment #20) > (In reply to comment #17) > > Thanks. Will test it out over the weekend > > Did you ever get a chance to test the kernel build out? Upstream is looking > for feedback. Didn't get a chance that weekend. But when I went back to look later, I could not find the compiled kernel rpm. the link you send me just included the srpm (In reply to comment #21) > (In reply to comment #20) > > (In reply to comment #17) > > > Thanks. Will test it out over the weekend > > > > Did you ever get a chance to test the kernel build out? Upstream is looking > > for feedback. > > Didn't get a chance that weekend. But when I went back to look later, I > could not find the compiled kernel rpm. the link you send me just included > the srpm That's because you waited a week and koji pruned the scratch build. It only keeps them for a week. I've submitted another for you to test here when it finishes building: http://koji.fedoraproject.org/koji/taskinfo?taskID=5121103 kernel-3.8.2-105.fc17 has been submitted as an update for Fedora 17. https://admin.fedoraproject.org/updates/FEDORA-2013-3638/kernel-3.8.2-105.fc17 kernel-3.8.3-101.fc17 has been submitted as an update for Fedora 17. https://admin.fedoraproject.org/updates/kernel-3.8.3-101.fc17 kernel-3.8.3-103.fc17 has been pushed to the Fedora 17 stable repository. If problems still persist, please make note of it in this bug report. |