Hide Forgot
Created attachment 1117016 [details] cinder.log Description of problem: Unable to attach volume to instance in IPv6 and SSL deployment Version-Release number of selected component (if applicable): openstack-tripleo-heat-templates-0.8.6-110.el7ost.noarch How reproducible: 100% Steps to Reproduce: 1. Deploy IPv6 and SSL enabled overcloud 2. Spawn an instance 3. Create a volume 4. Attach volume to intance Actual results: Volume doesn't get attached. Expected results: Volume gets attached. Additional info: Attaching the error log in cinder/volume.log
Guys, This issue is related to the LVM driver only! Unfortunately its really hard to say what exactly happened because Cinder failed to print an error message due to Unicode error, but most probably we failed to instantiate rtslib.NetworkPortal with IPv6 address. Some put that comment [1] in the rtstool.py for the good reason. Marius, Can I get an access to that environment to check my suspect? [1] # TODO(emh): Binding to IPv6 fails sometimes -- let pass for now.
I've proposed a fix upstream [1]. Let's see what community thinks about it. https://review.openstack.org/#/c/298143/
Created attachment 1195847 [details] compute log
Tested using: python-cinder-2015.1.3-8.el7ost.noarch python-cinderclient-1.2.1-3.el7ost.noarch openstack-cinder-2015.1.3-8.el7ost.noarch openstack-nova-compute-2015.1.4-13.el7ost.noarch openstack-nova-compute-2015.1.2-18.2.el7ost.noarch Verification flow: Failed to mount an empty volume to an instance. While the attaching process volume status enters to 'attaching' status and then returns to 'available' status. [stack@undercloud-0 ~]$ nova boot vm --image d1ad6bcb-8998-4df2-abf5-fa942369736c --nic net-id=348ac0ca-d028-49a2-932d-0d9505875ba1 --flavor 1 +--------------------------------------+---------------------------------------------+ | Property | Value | +--------------------------------------+---------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | - | | OS-EXT-SRV-ATTR:hypervisor_hostname | - | | OS-EXT-SRV-ATTR:instance_name | instance-00000004 | | OS-EXT-STS:power_state | 0 | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | - | | OS-SRV-USG:terminated_at | - | | accessIPv4 | | | accessIPv6 | | | adminPass | zECrj3Dq4FdX | | config_drive | | | created | 2016-08-30T09:55:20Z | | flavor | m1.tiny (1) | | hostId | | | id | 35f8da89-43c1-4e06-bab0-b27789b9779c | | image | None (d1ad6bcb-8998-4df2-abf5-fa942369736c) | | key_name | - | | metadata | {} | | name | vm | | os-extended-volumes:volumes_attached | [] | | progress | 0 | | security_groups | default | | status | BUILD | | tenant_id | f621e398b79040e6814d36ee8bb3a708 | | updated | 2016-08-30T09:55:20Z | | user_id | 9001851dd15a4facaabe999fd6a138b7 | +--------------------------------------+---------------------------------------------+ [stack@undercloud-0 ~]$ nova list +--------------------------------------+------+--------+------------+-------------+-----------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+------+--------+------------+-------------+-----------------------+ | 35f8da89-43c1-4e06-bab0-b27789b9779c | vm | ACTIVE | - | Running | private=192.168.100.4 | +--------------------------------------+------+--------+------------+-------------+-----------------------+ [stack@undercloud-0 ~]$ cinder create 1 +---------------------+--------------------------------------+ | Property | Value | +---------------------+--------------------------------------+ | attachments | [] | | availability_zone | nova | | bootable | false | | created_at | 2016-08-30T09:58:03.758940 | | display_description | None | | display_name | None | | encrypted | False | | id | effe1371-f773-4327-bed0-0eca7b7900c4 | | metadata | {} | | multiattach | false | | size | 1 | | snapshot_id | None | | source_volid | None | | status | creating | | volume_type | None | +---------------------+--------------------------------------+ [stack@undercloud-0 ~]$ cinder list +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ | ID | Status | Display Name | Size | Volume Type | Bootable | Attached to | +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ | effe1371-f773-4327-bed0-0eca7b7900c4 | available | - | 1 | - | false | | +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ [stack@undercloud-0 ~]$ nova volume-attach 35f8da89-43c1-4e06-bab0-b27789b9779c effe1371-f773-4327-bed0-0eca7b7900c4 +----------+--------------------------------------+ | Property | Value | +----------+--------------------------------------+ | device | /dev/vdb | | id | effe1371-f773-4327-bed0-0eca7b7900c4 | | serverId | 35f8da89-43c1-4e06-bab0-b27789b9779c | | volumeId | effe1371-f773-4327-bed0-0eca7b7900c4 | +----------+--------------------------------------+ [stack@undercloud-0 ~]$ cinder list +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ | ID | Status | Display Name | Size | Volume Type | Bootable | Attached to | +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ | effe1371-f773-4327-bed0-0eca7b7900c4 | attaching | - | 1 | - | false | | +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ [stack@undercloud-0 ~]$ cinder list +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ | ID | Status | Display Name | Size | Volume Type | Bootable | Attached to | +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ | effe1371-f773-4327-bed0-0eca7b7900c4 | available | - | 1 | - | false | | +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ From compute log: ------------------ Please find attached compute log ProcessExecutionError: Unexpected error while running command. 2016-08-30 10:02:30.649 10700 TRACE nova.compute.manager [instance: 35f8da89-43c1-4e06-bab0-b27789b9779c] Command: sudo nova-rootwrap /etc/nova/rootwrap.conf iscsiadm -m node -T iqn.2010-10.org.openstack:volume- effe1371-f773-4327-bed0-0eca7b7900c4 -p fd00:fd00:fd00:3000::11:3260 --rescan 2016-08-30 10:02:32.284 10700 TRACE oslo_messaging.rpc.dispatcher ProcessExecutionError: Unexpected error while running command. 2016-08-30 10:02:32.284 10700 TRACE oslo_messaging.rpc.dispatcher Command: sudo nova-rootwrap /etc/nova/rootwrap.conf iscsiadm -m node -T iqn.2010-10.org.openstack: volume-effe1371-f773-4327-bed0-0eca7b7900c4 -p fd00:fd00:fd00:3000::11:3260 --rescan
> Command: sudo nova-rootwrap /etc/nova/rootwrap.conf iscsiadm -m node -T iqn.2010-10.org.openstack:volume-effe1371-f773-4327-bed0-0eca7b7900c4 -p fd00:fd00:fd00:3000::11:3260 --rescan This looks bad, because the address should be [fd00:fd00:fd00:3000::11]:3260. This is similar to the fix we made in Cinder for this bug on the target side, but needs to be fixed on the initiator side.
Lowering priority as LVM is not a supported backend, but we want things to work for POCs and testing.