| Summary: | Unable to attach volume backed by LVM driver to instance in IPv6 and SSL deployment | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Product: | Red Hat OpenStack | Reporter: | Marius Cornea <mcornea> | ||||||
| Component: | openstack-cinder | Assignee: | Eric Harney <eharney> | ||||||
| Status: | CLOSED WONTFIX | QA Contact: | lkuchlan <lkuchlan> | ||||||
| Severity: | medium | Docs Contact: | |||||||
| Priority: | medium | ||||||||
| Version: | 7.0 (Kilo) | CC: | egafford, eharney, geguileo, jschluet, mburns, mcornea, nlevinki, ohochman, pgrist, rhel-osp-director-maint, scohen, sgotliv, srevivo, yrabl | ||||||
| Target Milestone: | --- | Keywords: | Triaged, ZStream | ||||||
| Target Release: | 7.0 (Kilo) | ||||||||
| Hardware: | Unspecified | ||||||||
| OS: | Unspecified | ||||||||
| Whiteboard: | |||||||||
| Fixed In Version: | openstack-cinder-2015.1.3-7.el7ost | Doc Type: | Bug Fix | ||||||
| Doc Text: | Story Points: | --- | |||||||
| Clone Of: | |||||||||
| : | 1320414 1336226 (view as bug list) | Environment: | |||||||
| Last Closed: | 2017-11-06 14:08:01 UTC | Type: | Bug | ||||||
| Regression: | --- | Mount Type: | --- | ||||||
| Documentation: | --- | CRM: | |||||||
| Verified Versions: | Category: | --- | |||||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||||
| Bug Depends On: | |||||||||
| Bug Blocks: | 1320414 | ||||||||
| Attachments: |
|
||||||||
Guys, This issue is related to the LVM driver only! Unfortunately its really hard to say what exactly happened because Cinder failed to print an error message due to Unicode error, but most probably we failed to instantiate rtslib.NetworkPortal with IPv6 address. Some put that comment [1] in the rtstool.py for the good reason. Marius, Can I get an access to that environment to check my suspect? [1] # TODO(emh): Binding to IPv6 fails sometimes -- let pass for now. I've proposed a fix upstream [1]. Let's see what community thinks about it. https://review.openstack.org/#/c/298143/ Created attachment 1195847 [details]
compute log
Tested using:
python-cinder-2015.1.3-8.el7ost.noarch
python-cinderclient-1.2.1-3.el7ost.noarch
openstack-cinder-2015.1.3-8.el7ost.noarch
openstack-nova-compute-2015.1.4-13.el7ost.noarch
openstack-nova-compute-2015.1.2-18.2.el7ost.noarch
Verification flow:
Failed to mount an empty volume to an instance.
While the attaching process volume status enters to 'attaching' status and then returns to 'available' status.
[stack@undercloud-0 ~]$ nova boot vm --image d1ad6bcb-8998-4df2-abf5-fa942369736c --nic net-id=348ac0ca-d028-49a2-932d-0d9505875ba1 --flavor 1
+--------------------------------------+---------------------------------------------+
| Property | Value |
+--------------------------------------+---------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | |
| OS-EXT-SRV-ATTR:host | - |
| OS-EXT-SRV-ATTR:hypervisor_hostname | - |
| OS-EXT-SRV-ATTR:instance_name | instance-00000004 |
| OS-EXT-STS:power_state | 0 |
| OS-EXT-STS:task_state | scheduling |
| OS-EXT-STS:vm_state | building |
| OS-SRV-USG:launched_at | - |
| OS-SRV-USG:terminated_at | - |
| accessIPv4 | |
| accessIPv6 | |
| adminPass | zECrj3Dq4FdX |
| config_drive | |
| created | 2016-08-30T09:55:20Z |
| flavor | m1.tiny (1) |
| hostId | |
| id | 35f8da89-43c1-4e06-bab0-b27789b9779c |
| image | None (d1ad6bcb-8998-4df2-abf5-fa942369736c) |
| key_name | - |
| metadata | {} |
| name | vm |
| os-extended-volumes:volumes_attached | [] |
| progress | 0 |
| security_groups | default |
| status | BUILD |
| tenant_id | f621e398b79040e6814d36ee8bb3a708 |
| updated | 2016-08-30T09:55:20Z |
| user_id | 9001851dd15a4facaabe999fd6a138b7 |
+--------------------------------------+---------------------------------------------+
[stack@undercloud-0 ~]$ nova list
+--------------------------------------+------+--------+------------+-------------+-----------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+------+--------+------------+-------------+-----------------------+
| 35f8da89-43c1-4e06-bab0-b27789b9779c | vm | ACTIVE | - | Running | private=192.168.100.4 |
+--------------------------------------+------+--------+------------+-------------+-----------------------+
[stack@undercloud-0 ~]$ cinder create 1
+---------------------+--------------------------------------+
| Property | Value |
+---------------------+--------------------------------------+
| attachments | [] |
| availability_zone | nova |
| bootable | false |
| created_at | 2016-08-30T09:58:03.758940 |
| display_description | None |
| display_name | None |
| encrypted | False |
| id | effe1371-f773-4327-bed0-0eca7b7900c4 |
| metadata | {} |
| multiattach | false |
| size | 1 |
| snapshot_id | None |
| source_volid | None |
| status | creating |
| volume_type | None |
+---------------------+--------------------------------------+
[stack@undercloud-0 ~]$ cinder list
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
| ID | Status | Display Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
| effe1371-f773-4327-bed0-0eca7b7900c4 | available | - | 1 | - | false | |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
[stack@undercloud-0 ~]$ nova volume-attach 35f8da89-43c1-4e06-bab0-b27789b9779c effe1371-f773-4327-bed0-0eca7b7900c4
+----------+--------------------------------------+
| Property | Value |
+----------+--------------------------------------+
| device | /dev/vdb |
| id | effe1371-f773-4327-bed0-0eca7b7900c4 |
| serverId | 35f8da89-43c1-4e06-bab0-b27789b9779c |
| volumeId | effe1371-f773-4327-bed0-0eca7b7900c4 |
+----------+--------------------------------------+
[stack@undercloud-0 ~]$ cinder list
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
| ID | Status | Display Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
| effe1371-f773-4327-bed0-0eca7b7900c4 | attaching | - | 1 | - | false | |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
[stack@undercloud-0 ~]$ cinder list
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
| ID | Status | Display Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
| effe1371-f773-4327-bed0-0eca7b7900c4 | available | - | 1 | - | false | |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
From compute log:
------------------
Please find attached compute log
ProcessExecutionError: Unexpected error while running command.
2016-08-30 10:02:30.649 10700 TRACE nova.compute.manager [instance: 35f8da89-43c1-4e06-bab0-b27789b9779c]
Command: sudo nova-rootwrap /etc/nova/rootwrap.conf iscsiadm -m node -T iqn.2010-10.org.openstack:volume-
effe1371-f773-4327-bed0-0eca7b7900c4 -p fd00:fd00:fd00:3000::11:3260 --rescan
2016-08-30 10:02:32.284 10700 TRACE oslo_messaging.rpc.dispatcher
ProcessExecutionError: Unexpected error while running command.
2016-08-30 10:02:32.284 10700 TRACE oslo_messaging.rpc.dispatcher
Command: sudo nova-rootwrap /etc/nova/rootwrap.conf iscsiadm -m node -T iqn.2010-10.org.openstack:
volume-effe1371-f773-4327-bed0-0eca7b7900c4 -p fd00:fd00:fd00:3000::11:3260 --rescan
> Command: sudo nova-rootwrap /etc/nova/rootwrap.conf iscsiadm -m node -T iqn.2010-10.org.openstack:volume-effe1371-f773-4327-bed0-0eca7b7900c4 -p fd00:fd00:fd00:3000::11:3260 --rescan
This looks bad, because the address should be [fd00:fd00:fd00:3000::11]:3260. This is similar to the fix we made in Cinder for this bug on the target side, but needs to be fixed on the initiator side.
Lowering priority as LVM is not a supported backend, but we want things to work for POCs and testing. |
Created attachment 1117016 [details] cinder.log Description of problem: Unable to attach volume to instance in IPv6 and SSL deployment Version-Release number of selected component (if applicable): openstack-tripleo-heat-templates-0.8.6-110.el7ost.noarch How reproducible: 100% Steps to Reproduce: 1. Deploy IPv6 and SSL enabled overcloud 2. Spawn an instance 3. Create a volume 4. Attach volume to intance Actual results: Volume doesn't get attached. Expected results: Volume gets attached. Additional info: Attaching the error log in cinder/volume.log