Red Hat Bugzilla – Bug 1333540
Lots of "Authentication failed" messages logged by snmpd on deployed OSP nodes
Last modified: 2018-02-05 14:02:04 EST
Description of problem: After deploying OpenStack, the system logs on the controller and compute nodes show repeated snmpd authentication failures by the director: [root@overcloud-compute-0 ~]# journalctl -u snmpd --no-pager [...] May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:48394->[192.168.1.9]:161 May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:48394->[192.168.1.9]:161 May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:48394->[192.168.1.9]:161 May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:36200->[192.168.1.9]:161 May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:36200->[192.168.1.9]:161 May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:36200->[192.168.1.9]:161 May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:36200->[192.168.1.9]:161 May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:36200->[192.168.1.9]:161 May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:36200->[192.168.1.9]:161 May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:54360->[192.168.1.9]:161 May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:54360->[192.168.1.9]:161 May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:54360->[192.168.1.9]:161 May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:54360->[192.168.1.9]:161 May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:54360->[192.168.1.9]:161 May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Connection from UDP: [192.168.1.1]:54360->[192.168.1.9]:161 May 05 14:00:00 overcloud-compute-0.localdomain snmpd[15737]: Authentication failed for ro_snmp_user Dozens of these messages are logged, every 10 minutes. Version-Release number of selected component (if applicable): QCIOOO-7-RHEL-7-20160408.t.1 How reproducible: 100% Steps to Reproduce: 1.) Deploy OpenStack. 2.) Look at system logs on deployed nodes. 3.) See repeated snmpd authentication failures. Actual results: Repeated snmpd authentication failures. Expected results: No snmpd authentication failures. Additional info: Following the steps in https://bugzilla.redhat.com/show_bug.cgi?id=1233251#c6 resolves the errors post-deployment. It looks the deployment needs to set the ceilometer username/password correctly to avoid these errors. [root@overcloud-compute-0 ~]# grep snmpd /etc/puppet/hieradata/compute.yaml snmpd_readonly_user_name: ro_snmp_user snmpd_readonly_user_password: 2f1a84b9dc77fdae23b7b0379f173c60ea432a4b [root@overcloud-controller-0 ~]# grep snmpd /etc/puppet/hieradata/controller.yaml snmpd_readonly_user_name: ro_snmp_user snmpd_readonly_user_password: 2f1a84b9dc77fdae23b7b0379f173c60ea432a4b [root@undercloud ~]# grep readonly /etc/ceilometer/ceilometer.conf #readonly_user_name=ro_snmp_user #readonly_user_password=password [root@undercloud ~]# openstack-config --set /etc/ceilometer/ceilometer.conf hardware readonly_user_name ro_snmp_user [root@undercloud ~]# openstack-config --set /etc/ceilometer/ceilometer.conf hardware readonly_user_password 2f1a84b9dc77fdae23b7b0379f173c60ea432a4b [root@undercloud ~]# systemctl restart openstack-ceilometer-central.service
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHEA-2017:3462