RDO tickets are now tracked in Jira https://issues.redhat.com/projects/RDO/issues/
Bug 1222124 - rdo-manager: fail to discover nodes with "instack-ironic-deployment --discover-nodes": ERROR: Data pre-processing failed
Summary: rdo-manager: fail to discover nodes with "instack-ironic-deployment --discove...
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: RDO
Classification: Community
Component: rdo-manager
Version: unspecified
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
: Kilo
Assignee: Imre Farkas
QA Contact: yeylon@redhat.com
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2015-05-15 19:55 UTC by Alexander Chuzhoy
Modified: 2018-05-02 10:48 UTC (History)
9 users (show)

Fixed In Version:
Clone Of:
Environment:
Last Closed: 2016-03-30 23:08:08 UTC
Embargoed:


Attachments (Terms of Use)
dmesg journalctl rdsosreport.txt (82.07 KB, application/x-gzip)
2015-05-25 14:15 UTC, Alexander Chuzhoy
no flags Details
system.journal from the system (253.53 KB, application/x-gzip)
2015-05-25 16:40 UTC, Alexander Chuzhoy
no flags Details
output from "journalctl -u openstack-ironic-discoverd.service -u openstack-ironic-discoverd-dnsmasq.service" (17.04 KB, application/x-gzip)
2015-05-25 16:59 UTC, Alexander Chuzhoy
no flags Details

Description Alexander Chuzhoy 2015-05-15 19:55:21 UTC
rdo-manager: fail to discover nodes with "instack-ironic-deployment --discover-nodes": ERROR: Data pre-processing failed

Environment:
instack-undercloud-2.1.1-dev13.el7.centos.noarch
instack-0.0.6-1.el7ost.noarch


Steps to reproduce:
1. Instakk the undercloud.
2. Register a node.
3. Attempt to discover the node(s) with instack-ironic-deployment --discover-nodes


Result:
Preparing for deployment...
  Discovering nodes.
    Sending node ID 7bb4b5c7-bb32-4d47-950c-d125a6ddec7f to discoverd for discovery ... DONE.
   Polling discoverd for discovery results ...
       Result for node 7bb4b5c7-bb32-4d47-950c-d125a6ddec7f is ... ERROR: Data pre-processing failed

Prepared.


Checking the console: the host drops into dracut-emergency.


Expected result:
The discovery should complete without errors.

Comment 1 chris alfonso 2015-05-20 17:57:12 UTC
The packages listed seem to be inconsistent with OSP-d. Please retest off the puddle and set the product/component appropriately.

Comment 2 Alexander Chuzhoy 2015-05-25 14:15:20 UTC
Created attachment 1029476 [details]
dmesg journalctl rdsosreport.txt

Comment 3 Alexander Chuzhoy 2015-05-25 14:16:25 UTC
This happens when there are no disks configured on the host being discovered.

Comment 4 Dmitry Tantsur 2015-05-25 15:37:24 UTC
Please get discoverd and ramdisk logs as described in https://repos.fedorapeople.org/repos/openstack-m/docs/master/troubleshooting/troubleshooting-nodes.html#where-are-the-logs
Logs provided do not contain required information.

Also please provide version of openstack-ironic-discoverd

Comment 5 Alexander Chuzhoy 2015-05-25 16:40:00 UTC
Created attachment 1029543 [details]
system.journal from the system

Comment 6 Dmitry Tantsur 2015-05-25 16:43:16 UTC
What's this binary file? I'm expecting to see discoverd logs and file from /var/log/ironic-discoverd/ramdisk

Comment 7 Alexander Chuzhoy 2015-05-25 16:51:07 UTC
This is the only existing file under /var/log.

Running "sudo journalctl -u openstack-ironic-discoverd -u openstack-ironic-discoverd-dnsmasq" as in the provided URL - returns an empty log.

Comment 8 Alexander Chuzhoy 2015-05-25 16:51:44 UTC
The RPM version: openstack-ironic-discoverd-1.1.0-1.el7ost.noarch

Comment 9 Alexander Chuzhoy 2015-05-25 16:53:25 UTC
You can gunzip the file and look through its content with: systemctl --file <path to the file>.

Comment 10 Alexander Chuzhoy 2015-05-25 16:59:32 UTC
Created attachment 1029544 [details]
output from "journalctl -u openstack-ironic-discoverd.service  -u openstack-ironic-discoverd-dnsmasq.service"

Comment 11 Dmitry Tantsur 2015-05-25 17:05:15 UTC
So, in the discoverd logs: "value for local_gb is missing or malformed:", which means that ramdisk did not send hard drive size. Now there should be files called "log" and "discoverd-log" in the ramdisk logs tarball, could you please find them?

Comment 12 Imre Farkas 2015-05-27 09:32:13 UTC
The issue is caused by ironic-discoverd always expecting a volume on the node. Before RAID configuration, there's no volume on the node, so discovery will fail. But the RAID configuration cannot be started before discovery because the target RAID configuration is tied to the deployment profiles, which is selected for each node based on the discovered facts.

Comment 13 Imre Farkas 2015-05-29 14:30:21 UTC
Patches
 - for discoverd: https://review.openstack.org/#/c/185896/
 - for discovery-ramdisk: https://review.openstack.org/#/c/186033/
 - for the ironic-discoverd element in instack-undercloud: https://review.gerrithub.io/#/c/234408/

Comment 15 hrosnet 2015-11-04 09:54:12 UTC
(In reply to Dmitry Tantsur from comment #11)
> So, in the discoverd logs: "value for local_gb is missing or malformed:",
> which means that ramdisk did not send hard drive size. Now there should be
> files called "log" and "discoverd-log" in the ramdisk logs tarball, could
> you please find them?

We faced the same message error today in a virtual machine:
'value for local_gb is missing or malformed:'

However that was due to a disk of 40Go while the partition was of 1Go.

Comment 16 hrosnet 2015-11-04 15:56:20 UTC
> (In reply to Dmitry Tantsur from comment #11)
> > So, in the discoverd logs: "value for local_gb is missing or malformed:",
> > which means that ramdisk did not send hard drive size. Now there should be
> > files called "log" and "discoverd-log" in the ramdisk logs tarball, could
> > you please find them?
> 
> We faced the same message error today in a virtual machine:
> 'value for local_gb is missing or malformed:'
> 
> However that was due to a disk of 40Go while the partition was of 1Go.

Sorry, haven't dig enough. It seems that this is linked to something else.
I'll open another bug if need be.(In reply to hrosnet from comment #15)

Comment 17 Amit Ugol 2018-05-02 10:48:57 UTC
closed, no need for needinfo.


Note You need to log in before you can comment on or make changes to this bug.