Bug 1262990 - [bug] watchdog can be pushed out after a panic is detected
[bug] watchdog can be pushed out after a panic is detected
Status: NEW
Product: Beaker
Classification: Community
Component: lab controller (Show other bugs)
20
Unspecified Unspecified
unspecified Severity unspecified (vote)
: ---
: ---
Assigned To: beaker-dev-list
tools-bugs
:
Depends On:
Blocks:
  Show dependency treegraph
 
Reported: 2015-09-14 16:19 EDT by Bill Peck
Modified: 2015-09-14 16:19 EDT (History)
4 users (show)

See Also:
Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
Environment:
Last Closed:
Type: Bug
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---


Attachments (Terms of Use)

  None (edit)
Description Bill Peck 2015-09-14 16:19:22 EDT
Description of problem:
When a panic is detencted by the lab controller it sets the current watchdog to ten minutes from the current time to give the system a chance to kdump if configured.

The problem is if kdump default configuration is to reboot the system.  This means its possible that the system under test could push the watchdog out again and attempt to run the test and possibly panic again.

Version-Release number of selected component (if applicable):
20.2

How reproducible:
Sun, moon and stars need to align

Actual results:
We had a bad kernel go through beaker which ended up filling the netdump server disk and kept the systems busy until someone manually canceled the job.

Several things had to go wrong.
1. bad kernel that caused a panic
2. bug in kdump that kept the system from halting
3. fsck? rolled changes back in filesystem which made the harness think it was running for the first time (rebootcount==0)

Expected results:
Once initial 10 minute watchdog timeout is set because of a panic it should not be changeable.

Additional info:
There is some other code in the abort code which looks like it can modify the watchdog time as well if WATCHDOG_SCRIPT is defined. So this could be tricky.

Note You need to log in before you can comment on or make changes to this bug.