Bug 1278558
| Summary: | Managing Cluster Size: one more step need to be added to 'Remove a Monitor -> manual' | ||
|---|---|---|---|
| Product: | [Red Hat Storage] Red Hat Ceph Storage | Reporter: | Harish NV Rao <hnallurv> |
| Component: | Documentation | Assignee: | ceph-docs <ceph-docs> |
| Status: | CLOSED CURRENTRELEASE | QA Contact: | ceph-qe-bugs <ceph-qe-bugs> |
| Severity: | high | Docs Contact: | |
| Priority: | unspecified | ||
| Version: | 1.3.1 | CC: | jowilkin, kchai, kdreyer, ngoswami, shmohan |
| Target Milestone: | rc | ||
| Target Release: | 1.3.1 | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | Bug Fix | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2015-12-18 09:59:56 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
|
Description
Harish NV Rao
2015-11-05 19:28:55 UTC
correction: Please read "1) the doc should contain a step to remove the above mentioned old dir before adding the mon on the same node. I will file a separate defect for that." as "1) the doc should contain a step to remove the above mentioned old dir" Thanks, Harish https://gitlab.cee.redhat.com/jowilkin/red-hat-ceph-storage-administration-guide/commit/9a6bed924ac78f9724a53497f3acad3961a9a5ba I've added a step for that now. Two things: A] There is no instruction to distribute the ceph.conf after removing the mon entry. Please add that. B] I am getting following error when I use umount command. [cephuser@magna040 ~]$ ll /var/lib/ceph/mon total 4 drwxr-xr-x. 3 root root 4096 Nov 7 03:44 ceph-magna040 [cephuser@magna040 ~]$ sudo umount /var/lib/ceph/mon/ceph-magna040 umount: /var/lib/ceph/mon/ceph-magna040: not mounted ----------------------------------------------------------- Following commands were run: sudo service ceph -a stop mon.magna040 sudo ceph mon remove magna040 sudo umount /var/lib/ceph/mon/ceph-magna040 --------------------------------------------------------- the "destroy_mon" in mon.py archives this /var/lib/ceph/mon/ceph-<mon-id> directory under /var/lib/ceph/mon-removed/. We may have to do similarly while removing a mon manually. You may want to check with Alfredo/Kefu on this. Kefu, can you please help here? Added an archive instruction and ceph-deploy config push. Umount is actually only if you added manually with intent to use a separate drive, like an SSD. You can just use rm. https://gitlab.cee.redhat.com/jowilkin/red-hat-ceph-storage-administration-guide/commit/acd2f0b42322773d0479316e209238ae59713f6b Thanks John! Kefu, please let us know if the steps mentioned above is fine with you. @Harish and @John, s/cp/mv/ and i agree that it's optional to backup the monstore. Hi Kefu, When 'mon destroy' command is used it archives the dir as: /var/lib/ceph/mon-removed/ceph-magna040-2015-11-06Z11:59:02 Is there any requirement in Ceph that removed mon's directory should be archived in a specific format as mentioned above? Please clarify Manual way suggests to move to just /var/lib/ceph/mon-removed/ceph-<mon-id>. If same mon is removed and added again then user has to rename it to something else. I hope that should be fine. Please confirm. Moving the defect to assigned state to incorporate Kefu's suggestions. Regards, Harish > Is there any requirement in Ceph that removed mon's directory should be archived in a specific format as mentioned above?
no. actually, i think that we backup the monstore just in case it's needed later. but as the monstore is updated very often. and a newly joined monitor will always be sync'ed with the latest monstore from its peer.
so it's fine to keep only one copy of the monstore.
Verified the document and changes are properly made. However one more thing need to be added in "Manual" mon addition section.https://gitlab.cee.redhat.com/jowilkin/red-hat-ceph-storage-administration-guide/blob/v1.3/cluster-size.adoc At step 4 of "Manual" mon addition section user has to run "ceph auth get mon. -o {tmp}/{key-filename}" command on the new mon node , since its a new machine there will be no admin.keyring on this machine so this command fails with "ubuntu@magna110:~$ sudo ceph auth get mon. -o ./tmp/keyring 2015-11-16 09:31:35.461940 7fe62e10a700 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication 2015-11-16 09:31:35.461946 7fe62e10a700 0 librados: client.admin initialization error (2) No such file or directory Error connecting to cluster: ObjectNotFound" @John, So I think we need to copy this key before running this command. Am I missing something ?? or its covered elsewhere?? @John, In the section "Manual" remove of mon nodes, If user performs step 5 then step 6 is not required. Could you please highlight this in the doc. I mean if you glance through the doc it looks like both the steps are required but its not . changing to assigned state to incorporate comments 10 and 11. @John, Can you incorporate comment 10 as well, otherwise "ceph auth get" fails with permission errors. Added "ceph-deploy --overwrite-conf admin <ceph-node>" command in the doc, this will copy the client.admin keyring and ceph.conf file to the destination node. hence marking this bug as verified. Fixed for 1.3.1 Release. |