Created attachment 880304 [details] logs Description of problem: ================= Trying to import ISO domain as POSIX fails - Trying to create POSIX ISO domain on the same path fails with domain already exists under the specified path importing it as NFS ISO Domain works fine. Version-Release number of selected component (if applicable): av5 How reproducible: 100% Steps to Reproduce: 1. import pre-configured POSIX ISO Domain. 2. 3. Actual results: can't import the POSIX ISO Domain. Expected results: should work. Additional info: "There is no storage domain under the specified path. Check event log for more details."
Could not reproduce: - Created an ISO domain within a directory - Verified that ISO domain works correctly - Detached and removed the ISO domain - Imported a POSIX ISO domain from that same directory - Verified that POSIX ISO domain was added to the pool up and running and with visible ISO files Perhaps you have some files missing from the pre-configured domain? Seems that d
Bug is only reproducible on a specific domain, leading us to think the problem is come corruption there. The general mechanism seems to work with every scenario we tested - pushing out to 3.5
Tried to verify yet again, import of a Posix ISO works correctly. As for the specific ISO domain used here, import as NFS works indeed and Posix does not yet it seems the directory structure in it is filled with unrelated files (for instance directories such as dev, bin, etc, lib, pub and so on), I don't know what happened there exactly but since this domain is garbaged with other files and directories and the steps to verify does work on a clear domain whether NFS or Posix, this is clearly not a bug
vt9 / vdsm-4.16.7.3-1.el7ev.x86_64 Could you at least check what causes the problem? Vague statement 'garbage' is not enough. IMO it could be related to some metadata. Our ISO domain work ok when imported as ISO/NFS but can't be imported as ISO/POSIX. ~~~ # cat /tmp/mnt/0c78b4d6-ba00-4d3e-9f9f-65c7d5899d71/dom_md/metadata CLASS=Iso DESCRIPTION=str01-iso-shared IOOPTIMEOUTSEC=1 LEASERETRIES=3 LEASETIMESEC=5 LOCKPOLICY= LOCKRENEWALINTERVALSEC=5 MASTER_VERSION=0 POOL_UUID=00000002-0002-0002-0002-0000000000a8,00000002-0002-0002-0002-0000000003b7,b196b498-58 7e-4816-bc5a-51ef53b0c113,00000002-0002-0002-0002-00000000001b,00000002-0002-0002-0002-00000000 035c,c77a15f7-3ebc-41ee-848b-828c5d23fa7a,a0bdf217-aa71-4a13-aa1a-b5d90479d7d8,40fbeaf5-9f50-49 68-8057-07c24a71a1d3,00000002-0002-0002-0002-0000000000c1,6cbf67cb-f0fd-46ec-80bf-893429e4cbd8, 143d1920-2053-4147-aa62-54e3d5410952,114d1fab-7836-4a69-a17e-b818bd3e1ded,00000002-0002-0002-00 02-00000000011e,8f51b3b0-2c8b-4bf5-b47b-c388d577e1ca,00000002-0002-0002-0002-000000000038,efd2c d86-8974-471e-add9-2bab5dd4d840,eafecef2-b5f7-438e-9f81-916dfc3d9f56,d534d431-4eda-45fa-9b48-61 d449ce642f,2f680e64-bd85-4bff-91a7-c79fba62e015,00000002-0002-0002-0002-00000000039c,00000002-0 002-0002-0002-0000000002bb,00000002-0002-0002-0002-000000000368,5849b030-626e-47cb-ad90-3ce782d 831b3,3a63d854-bed0-11e0-b671-545200312d04,00000002-0002-0002-0002-0000000003d3,00000002-0002-0 002-0002-00000000035b,00000002-0002-0002-0002-000000000183,a60fe7c4-3381-46bb-8937-fed13a9dbf9e ,d32f7967-ab43-40be-b38c-acab8349a068,ef5738b9-1abf-4313-bd90-a7f3d91acc59,6be4e600-1225-47f8-a 23d-28fa3ba07181,410465ad-b04a-45a4-83e1-9e6bc75fa3a7,8d42e82c-3106-4341-9916-6b28d7497f79,5841 c91d-8005-4eb0-8c21-6672e6fcef48,00000002-0002-0002-0002-000000000340,00000002-0002-0002-0002-0 0000000015b,d29f49de-6150-4042-8527-81fc7f5769ec,00000002-0002-0002-0002-000000000163,00000002- 0002-0002-0002-00000000033e,00000002-0002-0002-0002-000000000389,00000002-0002-0002-0002-000000 0000de,73cc3e87-7fd1-4716-bdb4-a9c8008bacd8,00000002-0002-0002-0002-00000000033b,00000002-0002- 0002-0002-0000000003e7,f876f8f5-a6c5-4e90-892e-052e1b1b9952,00000002-0002-0002-0002-0000000003e a,00000002-0002-0002-0002-0000000001c0,00000002-0002-0002-0002-000000000260,c72cba81-f484-4bbf- b09b-7b1b0caa31c8,bf064e33-4643-4393-bacc-f452521d8710,00000002-0002-0002-0002-000000000357,712 fb922-e3e5-4322-8473-ddb4db53cc3a,00000002-0002-0002-0002-0000000002d3 REMOTE_PATH=10.34.63.202:/home/iso/shared ROLE=Regular SDUUID=0c78b4d6-ba00-4d3e-9f9f-65c7d5899d71 TYPE=NFS VERSION=0 _SHA_CKSUM=d03e3d047e46577d2b274dc91f61eb6d5e5e4fbc ~~~ comparison with clean iso/posix domain ~~~ # cat /mnt/iso/2081fddb-cc4d-4d8d-af2c-71b7ca67292b/dom_md/metadata CLASS=Iso DESCRIPTION=iso IOOPTIMEOUTSEC=10 LEASERETRIES=3 LEASETIMESEC=60 LOCKPOLICY= LOCKRENEWALINTERVALSEC=5 POOL_UUID= REMOTE_PATH=10.34.63.199:/jbelka/iso ROLE=Regular SDUUID=2081fddb-cc4d-4d8d-af2c-71b7ca67292b TYPE=POSIXFS VERSION=0 _SHA_CKSUM=20baa17189b0dada086d48cf8c624c7b1c45661c ~~~ ~~~ Thread-909::DEBUG::2014-11-06 10:29:24,756::mount::227::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /usr/bin/umount -f -l /rhev/data-center/mnt/10.34.63.204:_home_iso_shared (cwd None) Thread-909::ERROR::2014-11-06 10:29:24,768::hsm::2531::Storage.HSM::(disconnectStorageServer) Could not disconnect from storageServer Traceback (most recent call last): File "/usr/share/vdsm/storage/hsm.py", line 2527, in disconnectStorageServer conObj.disconnect() File "/usr/share/vdsm/storage/storageServer.py", line 334, in disconnect return self._mountCon.disconnect() File "/usr/share/vdsm/storage/storageServer.py", line 235, in disconnect self._mount.umount(True, True) File "/usr/share/vdsm/storage/mount.py", line 254, in umount return self._runcmd(cmd, timeout) File "/usr/share/vdsm/storage/mount.py", line 239, in _runcmd raise MountError(rc, ";".join((out, err))) MountError: (32, ';umount: /rhev/data-center/mnt/10.34.63.204:_home_iso_shared: mountpoint not found\n') ~~~ seems odd, it first umounts the FS and then it complains about not able to disconnect?
Created attachment 954374 [details] vdsm.log
Guys, do we have an actual reproducer for this? On more than a specific, corrupted, domain?
Not that I am aware of.
Sudden rush of brains to the head: (In reply to Tal Nisan from comment #6) > Tried to verify yet again, import of a Posix ISO works correctly. > As for the specific ISO domain used here, import as NFS works indeed and > Posix does not yet it seems the directory structure in it is filled with > unrelated files (for instance directories such as dev, bin, etc, lib, pub > and so on), I don't know what happened there exactly but since this domain > is garbaged with other files and directories and the steps to verify does > work on a clear domain whether NFS or Posix, this is clearly not a bug Have you attempted to create an NFS/ISO domain, remove it, and then attach it as a POSIX/ISO domain? I suspect this may be the issue.
Tried just now: 1. Created a new NFS ISO domain 2. Detached it from the pool and removed it (without formatting) 3. Imported the domain to the pool as Posix ISO domain Working correctly
(In reply to Tal Nisan from comment #12) > Tried just now: > 1. Created a new NFS ISO domain > 2. Detached it from the pool and removed it (without formatting) > 3. Imported the domain to the pool as Posix ISO domain > > Working correctly In that case, closing. Without a reproducer that's better than "it's happens on this specific domain", there's nothing more we can (or at least should) do. QA - of course, if you have a proper reproducer, feel free to reopen this.