Bug 833590 - Audrey Agent Fails to Access RHEVm User Data
Summary: Audrey Agent Fails to Access RHEVm User Data
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: CloudForms Cloud Engine
Classification: Retired
Component: aeolus-audrey-agent
Version: 1.0.0
Hardware: Unspecified
OS: Unspecified
unspecified
low
Target Milestone: 1.0.1
Assignee: Joe Vlcek
QA Contact: Rehana
URL:
Whiteboard:
Depends On: 831645
Blocks:
TreeView+ depends on / blocked
 
Reported: 2012-06-19 20:15 UTC by Chris Pelland
Modified: 2012-07-10 07:24 UTC (History)
9 users (show)

Fixed In Version:
Clone Of: 831645
Environment:
Last Closed: 2012-07-10 07:24:12 UTC
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2012:1063 0 normal SHIPPED_LIVE CloudForms Cloud Engine 1.0.1 bug fix update 2012-07-10 11:18:41 UTC

Description Chris Pelland 2012-06-19 20:15:18 UTC
+++ This bug was initially created as a clone of Bug #831645 +++

Description of problem:

When the audrey agent launches it gives this error message:

# cat /var/log/audrey.log 
2012-06-13 14:45:07,425 - ERROR   : audrey:93 Failed accessing RHEVm user data.


Version-Release number of selected component (if applicable):

# rpm -qa | grep audrey
aeolus-audrey-agent-0.4.5-1.el6.noarch

The hypervisor is:
RHEL - 6Server - 6.2.0.3.el6
VDSM Version - 3.0.112.1

How reproducible:

Sometimes.  Not always.  Sometimes it works.

Steps to Reproduce:
1. Launch a instance that has a <services> element in the app blueprint
2.
3.
  
Actual results:
 fails with above message

Expected results:
accesses user data, contacts config server and runs scripts.

Additional info:


I see it probably 10-20% of launches.

--- Additional comment from scollier on 2012-06-13 21:20:18 EDT ---

I upgraded the RHEV environment to 3.0.3 today.  I just received the error again when launching to the RHEV environment:


# cat /var/log/audrey.log 
2012-06-14 02:21:47,611 - ERROR   : audrey:93 Failed accessing RHEVm user data.

--- Additional comment from dgao on 2012-06-14 10:03:33 EDT ---

This bug is caused by:

https://bugzilla.redhat.com/show_bug.cgi?id=831577

which is introduced by applying a bad patch that fixes 

https://bugzilla.redhat.com/show_bug.cgi?id=796528.

Closing this bug because it's not an audrey agent issue.

--- Additional comment from jprovazn on 2012-06-19 09:00:32 EDT ---

I don't think this is caused by 831577 because:
1) a patch for 831577 was pushed only to 1.0.1 branch (fix of this regression - 796528 - is already in 1.0.1 too), but AFAIK Scott used 1.0.0
2) the problem occurs in 10%-20%, the regression introduced by 831577 caused failure in 100%

Re-opening this bug - a problem is somewhere else.

--- Additional comment from JVLcek on 2012-06-19 16:03:54 EDT ---

I have a patch in the works. Testing has been successful.

Comment 1 Joe Vlcek 2012-06-20 16:31:06 UTC
commit f805fcad5ee0f844e0a6196719a2492c86da8d0b

Built as 0.4.10-1

Comment 3 Dan Macpherson 2012-06-25 15:19:59 UTC
    Technical note added. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    New Contents:
On rare occasions, Audrey Agent reports a miscommunication when accessing user data on Red Hat Enterprise Virtualization provides. This causes Audrey Agent to fail. This update provides Audrey Agent with the ability to retry connection. This helps overcome rare instances of miscommunication.

Comment 4 Dan Macpherson 2012-06-25 15:24:16 UTC
    Technical note updated. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    Diffed Contents:
@@ -1 +1 @@
-On rare occasions, Audrey Agent reports a miscommunication when accessing user data on Red Hat Enterprise Virtualization provides. This causes Audrey Agent to fail. This update provides Audrey Agent with the ability to retry connection. This helps overcome rare instances of miscommunication.+On rare occasions, Audrey Agent reports a miscommunication when accessing user data on Red Hat Enterprise Virtualization providers. This causes Audrey Agent to fail. This update provides Audrey Agent with the ability to retry connection. This helps overcome rare instances of miscommunication.

Comment 5 dgao 2012-06-25 18:13:12 UTC
In light of not able to reproduce the original error w/ RHEVM, I disabled the floppyinject to see if audrey-agent would retry multiple times.


[root@10-16-120-220 ~]# cat /var/log/audrey.log 
2012-06-25 14:06:50,319 - ERROR   : audrey:95 Failed accessing RHEVm user data: [Errno 2] No such file or directory: '/media/deltacloud-user-data.txt'
2012-06-25 14:06:53,358 - ERROR   : audrey:95 Failed accessing RHEVm user data: [Errno 2] No such file or directory: '/media/deltacloud-user-data.txt'
2012-06-25 14:06:59,370 - ERROR   : audrey:95 Failed accessing RHEVm user data: [Errno 2] No such file or directory: '/media/deltacloud-user-data.txt'
2012-06-25 14:07:11,392 - ERROR   : audrey:95 Failed accessing RHEVm user data: [Errno 2] No such file or directory: '/media/deltacloud-user-data.txt'
2012-06-25 14:07:35,426 - ERROR   : audrey:95 Failed accessing RHEVm user data: [Errno 2] No such file or directory: '/media/deltacloud-user-data.txt'
2012-06-25 14:08:23,482 - ERROR   : audrey:95 Failed accessing RHEVm user data: [Errno 2] No such file or directory: '/media/deltacloud-user-data.txt'
2012-06-25 14:09:59,497 - ERROR   : audrey:95 Failed accessing RHEVm user data: [Errno 2] No such file or directory: '/media/deltacloud-user-data.txt'
[root@10-16-120-220 ~]# rpm -qa | grep "aeolus-audrey"
aeolus-audrey-agent-0.4.10-1.el6cf.noarch

Comment 7 errata-xmlrpc 2012-07-10 07:24:12 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

http://rhn.redhat.com/errata/RHBA-2012-1063.html


Note You need to log in before you can comment on or make changes to this bug.