Bug 1333540

Summary:	Lots of "Authentication failed" messages logged by snmpd on deployed OSP nodes
Product:	Red Hat OpenStack	Reporter:	Tasos Papaioannou <tpapaioa>
Component:	openstack-tripleo-heat-templates	Assignee:	Emilien Macchi <emacchi>
Status:	CLOSED ERRATA	QA Contact:	Mehdi ABAAKOUK <mabaakou>
Severity:	medium	Docs Contact:
Priority:	medium
Version:	8.0 (Liberty)	CC:	bnemec, bthurber, dbecker, jcoufal, mabaakou, mburns, morazi, pkilambi, rhel-osp-director-maint, srevivo, tsanders, tvignaud
Target Milestone:	Upstream M2	Keywords:	Triaged
Target Release:	12.0 (Pike)
Hardware:	All
OS:	Linux
Whiteboard:
Fixed In Version:	openstack-tripleo-heat-templates-7.0.0-0.20170616123155.el7ost	Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2017-12-13 20:41:55 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1233251
Bug Blocks:	1273561

Description Tasos Papaioannou 2016-05-05 19:15:27 UTC

Description of problem:

After deploying OpenStack, the system logs on the controller and compute nodes show repeated snmpd authentication failures by the director:

[root@overcloud-compute-0 ~]# journalctl -u snmpd --no-pager
[...]
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:48394->[192.168.1.9]:161
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:48394->[192.168.1.9]:161
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:48394->[192.168.1.9]:161
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:36200->[192.168.1.9]:161
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:36200->[192.168.1.9]:161
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:36200->[192.168.1.9]:161
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:36200->[192.168.1.9]:161
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:36200->[192.168.1.9]:161
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:36200->[192.168.1.9]:161
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:54360->[192.168.1.9]:161
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:54360->[192.168.1.9]:161
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:54360->[192.168.1.9]:161
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:54360->[192.168.1.9]:161
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:54360->[192.168.1.9]:161
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:54360->[192.168.1.9]:161
May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user

Dozens of these messages are logged, every 10 minutes.


Version-Release number of selected component (if applicable):

QCIOOO-7-RHEL-7-20160408.t.1

How reproducible:

100%

Steps to Reproduce:
1.) Deploy OpenStack.
2.) Look at system logs on deployed nodes.
3.) See repeated snmpd authentication failures.

Actual results:

Repeated snmpd authentication failures.

Expected results:

No snmpd authentication failures.

Additional info:

Following the steps in https://bugzilla.redhat.com/show_bug.cgi?id=1233251#c6 resolves the errors post-deployment. It looks the deployment needs to set the ceilometer username/password correctly to avoid these errors.

[root@overcloud-compute-0 ~]# grep snmpd /etc/puppet/hieradata/compute.yaml 
snmpd_readonly_user_name: ro_snmp_user
snmpd_readonly_user_password: 2f1a84b9dc77fdae23b7b0379f173c60ea432a4b

[root@overcloud-controller-0 ~]# grep snmpd /etc/puppet/hieradata/controller.yaml 
snmpd_readonly_user_name: ro_snmp_user
snmpd_readonly_user_password: 2f1a84b9dc77fdae23b7b0379f173c60ea432a4b

[root@undercloud ~]# grep readonly /etc/ceilometer/ceilometer.conf 
#readonly_user_name=ro_snmp_user
#readonly_user_password=password

[root@undercloud ~]# openstack-config --set /etc/ceilometer/ceilometer.conf hardware readonly_user_name ro_snmp_user
[root@undercloud ~]# openstack-config --set /etc/ceilometer/ceilometer.conf hardware readonly_user_password 2f1a84b9dc77fdae23b7b0379f173c60ea432a4b
[root@undercloud ~]# systemctl restart openstack-ceilometer-central.service

Comment 14 errata-xmlrpc 2017-12-13 20:41:55 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2017:3462