Bug 1371071

Summary:	[WALA][RHEL-6] AutoUpdate WALA error
Product:	Red Hat Enterprise Linux 6	Reporter:	Yuxin Sun <yuxisun>
Component:	WALinuxAgent	Assignee:	Miroslav Rezanina <mrezanin>
Status:	CLOSED CURRENTRELEASE	QA Contact:	Virtualization Bugs <virt-bugs>
Severity:	medium	Docs Contact:
Priority:	medium
Version:	6.8	CC:	leiwang, mkolaja, wshi, yuxisun
Target Milestone:	rc	Keywords:	Extras, Tracking
Target Release:	---
Hardware:	x86_64
OS:	Linux
Whiteboard:
Fixed In Version:	WALinuxAgent-2.2.4	Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2017-03-07 08:53:01 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:

Description Yuxin Sun 2016-08-29 09:36:40 UTC

This is used to track the issue on GitHub:
https://github.com/Azure/WALinuxAgent/issues/389

Description of problem:
waagent fails to run the AutoUpdated WALA process.

Version-Release number of selected component (if applicable):
WALinuxAgent-2.1.5

RHEL Version: RHEL-6.8-20160414.0
Python Version: 2.6.6

How reproducible:
100%

Steps to Reproduce:
1. Prepare a RHEL7.3 VM on Azure East US location(ASM mode) with WALA-2.1.5 installed. Enable wala auto-update in the /etc/waagent.conf:
# AutoUpdate.Enabled=y
# AutoUpdate.GAFamily=Prod
Then restart waagent service
# service waagent restart
2. Wait until the new WALA package is downloaded. Check waagent.log. Check the -run-exthandler process.


Actual results:
waagent can't run the new WALA.
There's error logs in waagent.log:
2016/08/24 17:43:21.094375 INFO Instantiating Agent WALinuxAgent-2.1.6 from disk
2016/08/24 17:43:21.102146 INFO Agent WALinuxAgent-2.1.6 error state: Last Failure: 0.0, Total Failures: 0, Fatal: False
2016/08/24 17:43:21.113080 INFO Ensuring Agent WALinuxAgent-2.1.6 is downloaded
2016/08/24 17:43:21.121714 INFO Agent WALinuxAgent-2.1.6 was previously downloaded - skipping download
2016/08/24 17:43:21.132177 INFO Agent WALinuxAgent-2.1.6 loaded manifest from /var/lib/waagent/WALinuxAgent-2.1.6/HandlerManifest.json
2016/08/24 17:43:21.144947 INFO Determined Agent WALinuxAgent-2.1.6 to be the latest agent
2016/08/24 17:43:21.164787 WARNING Agent WALinuxAgent-2.1.6 launched with command 'python -u bin/WALinuxAgent-2.1.6-py2.7.egg -run-exthandlers' failed with exception: execv() argument 1 must be encoded string without NULL bytes, not str
2016/08/24 17:43:21.189836 ERROR Event: name=WALinuxAgent, op=Enable, message=Agent WALinuxAgent-2.1.6 launched with command 'python -u bin/WALinuxAgent-2.1.6-py2.7.egg -run-exthandlers' failed with exception: execv() argument 1 must be encoded string without NULL bytes, not str
2016/08/24 17:43:21.214555 WARNING Agent WALinuxAgent-2.1.6 is permanently blacklisted
2016/08/24 17:43:21.226883 INFO Installed Agent WALinuxAgent-2.1.5 is the most current agent
2016/08/24 17:43:21.243329 INFO Agent WALinuxAgent-2.1.5 launched with command 'python -u /usr/sbin/waagent -run-exthandlers'


Expected results:
waagent runs the new WALA.


Additional info:
1. Only exists in RHEL-6. Doesn't exist in RHEL-7.
2. If install WALA-2.1.6 directly, there's no error log. Only exists during AutoUpdate.

Comment 2 Yuxin Sun 2016-11-21 06:01:53 UTC

Verify on WALA-2.2.0 RHEL-6.8 ondemand VM. Can autoupdate the guest agent from WALA-2.2.0 to WALA-2.2.1 and works well.

# ps aux|grep -E "waagent|WAL"
root      2040  0.1  0.6 203748 11112 pts/0    S    00:52   0:00 python /usr/sbin/waagent -daemon
root      2063  0.4  0.9 368984 16952 pts/0    Sl   00:53   0:00 python -u bin/WALinuxAgent-2.2.1-py2.7.egg -run-exthandlers

# waagent -version
WALinuxAgent-2.2.0 running on redhat 6.8
Python: 2.6.6
Goal state agent: 2.2.1

There's no error log in the waagent.log.

Comment 3 Yuxin Sun 2017-03-06 03:16:40 UTC

Change the status to "POST" for developers to add it into ERRATA.