Bug 1323845 - [RH Ceph 2.0 / 10.1.0] rbd map sysfs write failed
Summary: [RH Ceph 2.0 / 10.1.0] rbd map sysfs write failed
Keywords:
Status: CLOSED NOTABUG
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat
Component: RBD
Version: 2.0
Hardware: Unspecified
OS: Unspecified
unspecified
medium
Target Milestone: rc
: 2.0
Assignee: Josh Durgin
QA Contact: ceph-qe-bugs
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-04-04 22:44 UTC by Vasu Kulkarni
Modified: 2022-02-21 18:05 UTC (History)
2 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2016-04-05 00:56:44 UTC
Target Upstream Version:


Attachments (Terms of Use)

Description Vasu Kulkarni 2016-04-04 22:44:06 UTC
Description of problem:

2016-04-04T18:02:10.609 INFO:tasks.rbd:Creating image testimage.client.0 with size 20480
2016-04-04T18:02:10.609 INFO:teuthology.orchestra.run.clara010:Running: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rbd -p rbd create --size 20480 testimage.client.0'
2016-04-04T18:02:12.076 INFO:tasks.rbd:Loading rbd kernel module...
2016-04-04T18:02:12.078 INFO:teuthology.orchestra.run.clara010:Running: 'sudo modprobe rbd'
2016-04-04T18:02:12.153 INFO:tasks.rbd:Creating rbd block devices...
2016-04-04T18:02:12.154 INFO:teuthology.orchestra.run.clara010:Running: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rbd --user 0 -p rbd map testimage.client.0 && while test '!' -e /dev/rbd/rbd/testimage.client.0 ; do sleep 1 ; done"
2016-04-04T18:02:12.339 INFO:teuthology.orchestra.run.clara010.stderr:rbd: sysfs write failed
2016-04-04T18:02:12.340 INFO:teuthology.orchestra.run.clara010.stderr:rbd: map failed: (6) No such device or address

Version-Release number of selected component (if applicable):
 ceph version 10.1.0-1.el7cp (61adb020219fbad4508050b5f0a792246ba74dae)

How reproducible:
1/1

Steps to Reproduce:
Run rbd iozone test


Actual results:


2016-04-04T18:02:09.331 INFO:teuthology.orchestra.run.clara002:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph osd pool get rbd pg_num'
2016-04-04T18:02:09.715 INFO:teuthology.orchestra.run.clara002:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph osd pool get cephfs_metadata pg_num'
2016-04-04T18:02:10.096 INFO:teuthology.orchestra.run.clara002:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph osd pool get cephfs_data pg_num'
2016-04-04T18:02:10.483 INFO:teuthology.run_tasks:Running task rbd...
2016-04-04T18:02:10.608 DEBUG:tasks.rbd:rbd config is: {'client.0': {'image_size': 20480}}
2016-04-04T18:02:10.609 INFO:tasks.rbd:Creating image testimage.client.0 with size 20480
2016-04-04T18:02:10.609 INFO:teuthology.orchestra.run.clara010:Running: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rbd -p rbd create --size 20480 testimage.client.0'
2016-04-04T18:02:12.076 INFO:tasks.rbd:Loading rbd kernel module...
2016-04-04T18:02:12.078 INFO:teuthology.orchestra.run.clara010:Running: 'sudo modprobe rbd'
2016-04-04T18:02:12.153 INFO:tasks.rbd:Creating rbd block devices...
2016-04-04T18:02:12.154 INFO:teuthology.orchestra.run.clara010:Running: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rbd --user 0 -p rbd map testimage.client.0 && while test '!' -e /dev/rbd/rbd/testimage.client.0 ; do sleep 1 ; done"
2016-04-04T18:02:12.339 INFO:teuthology.orchestra.run.clara010.stderr:rbd: sysfs write failed
2016-04-04T18:02:12.340 INFO:teuthology.orchestra.run.clara010.stderr:rbd: map failed: (6) No such device or address
2016-04-04T18:02:12.343 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_rh2/teuthology/contextutil.py", line 28, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/ceph-qa-suite_jewel/tasks/rbd.py", line 257, in dev_create
    'done',
  File "/home/teuthworker/src/teuthology_rh2/teuthology/orchestra/remote.py", line 196, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_rh2/teuthology/orchestra/run.py", line 378, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_rh2/teuthology/orchestra/run.py", line 114, in wait
    label=self.label)
CommandFailedError: Command failed on clara010 with status 6: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rbd --user 0 -p rbd map testimage.client.0 && while test '!' -e /dev/rbd/rbd/testimage.client.0 ; do sleep 1 ; done"
2016-04-04T18:02:12.346 INFO:tasks.rbd:Unloading rbd kernel module...
2016-04-04T18:02:12.347 INFO:teuthology.orchestra.run.clara010:Running: 'sudo modprobe -r rbd || true'
2016-04-04T18:02:12.414 INFO:tasks.rbd:Deleting rbd images...
2016-04-04T18:02:12.416 INFO:teuthology.orchestra.run.clara010:Running: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rbd -p rbd rm testimage.client.0'
2016-04-04T18:02:12.622 INFO:teuthology.orchestra.run.clara010.stderr:
Removing image: 1% complete...
Removing image: 2% complete...
Removing image: 3% complete...
Removing image: 4% complete...
Removing image: 5% complete...
Removing image: 6% complete...
Removing image: 7% complete...
Removing image: 8% complete...
Removing image: 9% complete...
Removing image: 10% complete...
Removing image: 11% complete...
Removing image: 12% complete...
Removing image: 13% complete...
Removing image: 14% complete...
Removing image: 15% complete...
Removing image: 16% complete...
Removing image: 17% complete...
Removing image: 18% complete...
Removing image: 19% complete...
Removing image: 20% complete...
Removing image: 21% complete...
Removing image: 22% complete...
Removing image: 23% complete...
Removing image: 24% complete...
Removing image: 25% complete...
Removing image: 26% complete...
Removing image: 27% complete...
Removing image: 28% complete...
Removing image: 29% complete...
Removing image: 30% complete...
Removing image: 31% complete...
Removing image: 32% complete...
Removing image: 33% complete...
Removing image: 34% complete...
Removing image: 35% complete...
Removing image: 36% complete...
Removing image: 37% complete...
Removing image: 38% complete...
Removing image: 39% complete...
Removing image: 40% complete...
Removing image: 41% complete...
Removing image: 42% complete...
Removing image: 43% complete...
Removing image: 44% complete...
Removing image: 45% complete...
Removing image: 46% complete...
Removing image: 47% complete...
Removing image: 48% complete...
Removing image: 49% complete...
Removing image: 50% complete...
Removing image: 51% complete...
Removing image: 52% complete...
Removing image: 53% complete...
Removing image: 54% complete...
Removing image: 55% complete...
Removing image: 56% complete...
Removing image: 57% complete...
Removing image: 58% complete...
Removing image: 59% complete...
Removing image: 60% complete...
Removing image: 61% complete...
Removing image: 62% complete...
Removing image: 63% complete...
Removing image: 64% complete...
Removing image: 65% complete...
Removing image: 66% complete...
Removing image: 67% complete...
Removing image: 68% complete...
Removing image: 69% complete...
Removing image: 70% complete...
Removing image: 71% complete...
Removing image: 72% complete...
Removing image: 73% complete...
Removing image: 74% complete...
Removing image: 75% complete...
Removing image: 76% complete...
Removing image: 77% complete...
Removing image: 78% complete...
Removing image: 79% complete...
Removing image: 80% complete...
Removing image: 81% complete...
Removing image: 82% complete...
Removing image: 83% complete...
Removing image: 84% complete...
Removing image: 85% complete...
Removing image: 86% complete...
Removing image: 87% complete...
Removing image: 88% complete...
Removing image: 89% complete...
Removing image: 90% complete...
Removing image: 91% complete...
Removing image: 92% complete...
Removing image: 93% complete...
Removing image: 94% complete...
Removing image: 95% complete...
Removing image: 96% complete...
Removing image: 97% complete...
Removing image: 98% complete...
Removing image: 99% complete...
Removing image: 100% complete...done.
2016-04-04T18:02:12.625 ERROR:teuthology.run_tasks:Saw exception from tasks.

Expected results:



Additional info:
http://magna002.ceph.redhat.com/vasu-2016-04-04_15:32:20-smoke-jewel---basic-clara/217139/teuthology.log

Comment 2 Josh Durgin 2016-04-05 00:56:44 UTC
The test suite needs to change the default features to just layering, which is all the kernel supports. You should rebase your ceph-qa-suite branches to pick up this change from f9a69022564a1bbf76d38f8b7ef5b9fe1a387be5 and 48599465d6f1c1c61dde1501e532839fe8999de2


Note You need to log in before you can comment on or make changes to this bug.