Description of problem: Serial console logs are not available for recipes running on oVirt/RHEV dynamic VMs. Version-Release number of selected component (if applicable): 0.12.0 How reproducible: always Steps to Reproduce: 1. Schedule a recipe which is virtualisable 2. Watch it run 3. No console.log Additional info: The console log is necessary to diagnose many kinds of problems, including errors reported by Anaconda, problems with the boot images, a misconfigured VM, failures in the harness, network problems communicating with Beaker...
Part of this bug fix should be to fix beaker-watchdog not to look for /var/consoles/None while the VM is installing.
This will be an issue when we port to OpenStack as well.
OpenStack has an API for fetching the serial console log for an instance (it returns the entire thing). So the first draft of this feature: * Make instances use the serial console (probably just need to add console=ttyS0 to kernel options for all OpenStack instances) * Make beaker-watchdog aware of the instance ID for OpenStack instances, and some usable credentials to authenticate to OpenStack * Instead of reading the console from /var/consoles beaker-watchdog should use the OpenStack API to fetch the entire console log, and run it through the usual processing (wipe control characters, check for panics and install failures, store a copy locally) Bonus points for: * Patching OpenStack to support fetching a range of bytes from the log, instead of the whole thing, so that we can more efficiently poll it * Make it possible to log in to the console even when console=ttyS0 is passed (currently that will make the system use the serial console for /dev/console but OpenStack does not expose a writable serial console which leaves no way to log in)
I have opened a bug for OpenStack to support fetching a selecting range of console logs. https://bugs.launchpad.net/nova/+bug/1337695 Cheers,Matt Jia
On gerrit http://gerrit.beaker-project.org/#/c/3181/ Cheers, Matt Jia
OpenStack has a size limit for getting console logs.I have field a bug to increase this which should be big enough for us to get the whole thing. https://bugs.launchpad.net/nova/+bug/1341363 In the future, we can switch to the interactive web-based serial consoles which they are currently working on. https://review.openstack.org/#/c/86418/7/specs/juno/serial-ports.rst Cheers,Matt Jia
I found a new issue when I upgraded the above fix to beaker-devel.Move back to ASSGINED To get this fix done.
On Gerrit: http://gerrit.beaker-project.org/#/c/3215/ Cheers, Matt Jia
This was actually in Beaker 0.18.0.