Bug 1300617
| Summary: | Unable to prepare/Activate a SSD disk in Ceph Cluster | ||
|---|---|---|---|
| Product: | [Red Hat Storage] Red Hat Ceph Storage | Reporter: | Tanay Ganguly <tganguly> |
| Component: | RADOS | Assignee: | Loic Dachary <ldachary> |
| Status: | CLOSED DUPLICATE | QA Contact: | ceph-qe-bugs <ceph-qe-bugs> |
| Severity: | high | Docs Contact: | Bara Ancincova <bancinco> |
| Priority: | unspecified | ||
| Version: | 1.3.2 | CC: | bancinco, ceph-eng-bugs, dzafman, flucifre, hnallurv, kchai, kdreyer, kurs, ldachary |
| Target Milestone: | rc | ||
| Target Release: | 1.3.3 | ||
| Hardware: | x86_64 | ||
| OS: | Linux | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | Known Issue | |
| Doc Text: |
.The "ceph-disk prepare" command fails on SSD disks
An attempt to prepare Solid-state Drives (SSDs) by running the `ceph-disk prepare` command fails. To work around this issue, perform the steps below:
. Manually remove the `udev` rules by running the following command as `root`:
+
----
# rm /usr/lib/udev/rules.d/95-ceph-osd.rules
----
. Prepare the disks:
+
----
$ ceph-disk prepare
----
. Add the "ceph-disk activate-all" string to the `/etc/rc.local` file. Run the following command as `root`:
+
----
# echo "ceph-disk activate-all" | tee -a /etc/rc.local
----
. Reboot the system or activate the disks by running the following command as `root`:
+
----
# ceph-disk activate-all
----
|
Story Points: | --- |
| Clone Of: | Environment: | ||
| Last Closed: | 2016-03-21 23:47:36 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
|
Description
Tanay Ganguly
2016-01-21 09:46:53 UTC
Loic, is this an issue in ceph-disk? This is mostly likely a consequence of http://tracker.ceph.com/issues/14099 http://tracker.ceph.com/issues/14099 is not fixed upstream - re-targeting to RHCS 1.3.3 @Ken, backporting is behind because the test infrastructure was disturbed in the past few weeks. Needinfo Ken — if we can do this in 1.3.2 he will let us know, at this time I am not re-targeting from 1.3.3 unless Dev gives us the go-ahead. Loic helped me understand that in Infernalis/Jewel, there was a large refactor of the ceph-disk workflow and how it relates to the init system and udev. So things are going to get more stable in RHCS 2.0. But we can't easily cherry-pick this work to RHCS 1.3. In the mean time, for Hammer, it's possible that we can document a workaround for users who hit ceph-disk issues. Discussion ongoing upstream: http://www.spinics.net/lists/ceph-devel/msg28384.html @Ken right ! The safe way to address this problem is to remove the udev rules and manually run ceph-disk prepare for the desired disks. It won't activate them but it should be free of undesired interferences / races. Once the disks are prepared, a call to ceph-disk activate-all can be added to /etc/rc.local or something similar. It will sequentially activate all prepared disks and, again, will be safe of any udev / initsystem interferences. Some stability fixes are backported and having them will help in some cases, but they are no cure for a more general problem. The infernalis release fixed all this, fortunately ;-) This is presumed to be racy-ness in ceph-disk, not a regression. It should be documented in the release notes nonetheless. Hi Bara, As per doc text . Manually remove the `udev` rules by running the following command as `root`: + ---- # rm /usr/lib/path/to/udev.rule I am unable to find the udev.rule file, do you mean /usr/lib/udev/rules.d/* If yes, which specific file we need to remove. Is it /usr/lib/udev/rules.d/50-udev-default.rules ? rm /usr/lib/udev/rules.d/95-ceph-osd.rules Is the file that needs to be removed Bara, I followed the Doc test mentioned, and it is working fine, I am not seeing any Error while Preparing the SSD. NOTE: I just tried it once. *** This bug has been marked as a duplicate of bug 1300703 *** |