Bug 451798 - ec2 status for terminated and removed job not handled properly
ec2 status for terminated and removed job not handled properly
Product: Red Hat Enterprise MRG
Classification: Red Hat
Component: condor (Show other bugs)
All Linux
medium Severity high
: 2.0
: ---
Assigned To: grid-maint-list
MRG Quality Engineering
Depends On:
  Show dependency treegraph
Reported: 2008-06-17 09:49 EDT by Matthew Farrellee
Modified: 2011-01-07 12:58 EST (History)
2 users (show)

See Also:
Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
Last Closed: 2011-01-07 12:58:27 EST
Type: ---
Regression: ---
Mount Type: ---
Documentation: ---
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---

Attachments (Terms of Use)

  None (edit)
Description Matthew Farrellee 2008-06-17 09:49:52 EDT
EC2's DescribeInstances command keeps instances in the terminated state around
for a set period of time, after that period they are no longer reported and can
result in either no response or InvalidInstanceId.NotFound (former is observed).
If the latter is reported, the amazon-gahp returns '1' 
'0' '' '' '', not InvalidInstanceId.NotFound to the gridmanager.
Comment 1 Jaime Frey 2008-09-10 16:10:59 EDT
This behavior is intentional. The amazon_gahp will turn InvalidInstanceID.NotFound errors into successful operations for AMAZON_VM_STATUS and AMAZON_VM_STOP commands. This was done to simplify the error-handling in the gridmanager. If we don't want the gahp to eat these errors, we'll have to modify the gridmanager to recognize them and react appropriately.
Comment 2 Matthew Farrellee 2008-09-11 00:31:47 EDT
I think my description may have been poorly worded. The issue was that instances that are no longer reported by EC2 as even existing were not being handled properly. This is the case of EC2 removing all knowledge of an instance before AMAZON_VM_STATUS can be sent to query the instance. The semantics should be that in such a case the instance is considered terminated, but that wasn't happening. Testing this means withholding AMAZON_VM_STATUS commands until the instance has moved into the terminated state and been flushed from the output of ec2-describe-instances.
Comment 3 Jan Sarenik 2008-12-08 03:57:46 EST
FYI: amazon-gahp was renamed to amazon_gahp
in version 7.2.0-0.8 (7.2.0 pre-release)
Comment 4 Matthew Farrellee 2011-01-07 12:58:27 EST
If this appears again or more frequently it can be re-opened.

Note You need to log in before you can comment on or make changes to this bug.