Attachment 1910585 Details for Bug 2125433 – mgr snippet logs

mgr snippet logs

mgrlogsdashboard.txt (text/plain), 43.28 KB, created by Preethi on 2022-09-09 02:44:43 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Preethi

Created: 2022-09-09 02:44:43 UTC

Size: 43.28 KB

patch

obsolete

>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>::ffff:10.8.128.21 - - [08/Sep/2022:07:43:05] "GET /metrics HTTP/1.1" 200 1042443 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:43:15] "GET /metrics HTTP/1.1" 200 1042442 "" "Prometheus/2.33.4"
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>::ffff:10.8.128.21 - - [08/Sep/2022:07:43:25] "GET /metrics HTTP/1.1" 200 1042442 "" "Prometheus/2.33.4"
>Dashboard Exception
>Traceback (most recent call last):
>  File "/usr/share/ceph/mgr/dashboard/services/exception.py", line 47, in dashboard_exception_handler
>    return handler(*args, **kwargs)
>  File "/lib/python3.9/site-packages/cherrypy/_cpdispatch.py", line 54, in __call__
>    return self.callable(*self.args, **self.kwargs)
>  File "/usr/share/ceph/mgr/dashboard/controllers/_base_controller.py", line 258, in inner
>    ret = func(*args, **kwargs)
>  File "/usr/share/ceph/mgr/dashboard/controllers/_rest_controller.py", line 191, in wrapper
>    return func(*vpath, **params)
>  File "/lib64/python3.9/contextlib.py", line 79, in inner
>    return func(*args, **kwds)
>  File "/lib64/python3.9/contextlib.py", line 79, in inner
>    return func(*args, **kwds)
>  File "/usr/share/ceph/mgr/dashboard/controllers/rbd.py", line 105, in list
>    return self._rbd_list(pool_name)
>  File "/usr/share/ceph/mgr/dashboard/controllers/rbd.py", line 90, in _rbd_list
>    status, value = RbdService.rbd_pool_list(pool)
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 245, in wrapper
>    return rvc.run(fn, args, kwargs)
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 233, in run
>    raise ViewCacheNoDataException()
>dashboard.exceptions.ViewCacheNoDataException: ViewCache: unable to retrieve data
>::ffff:10.8.128.21 - - [08/Sep/2022:07:43:35] "GET /metrics HTTP/1.1" 200 1042631 "" "Prometheus/2.33.4"
>Error while calling fn=<function RbdService.rbd_pool_list at 0x7ff9cd3f7790> ex=[errno 19] error generating diff from snapshot None
>Traceback (most recent call last):
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 147, in run
>    val = self.fn(*self.args, **self.kwargs)
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 421, in rbd_pool_list
>    stat = cls._rbd_image_stat(
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 386, in _rbd_image_stat
>    return cls._rbd_image(ioctx, pool_name, namespace, image_name)
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 360, in _rbd_image
>    total_prov_bytes, snaps_prov_bytes = cls._rbd_disk_usage(
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 256, in _rbd_disk_usage
>    image.diff_iterate(0, size, prev_snap, du_callb,
>  File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
>  File "rbd.pyx", line 3925, in rbd.Image.diff_iterate
>rbd.OSError: [errno 19] error generating diff from snapshot None
>::ffff:10.8.128.21 - - [08/Sep/2022:07:43:45] "GET /metrics HTTP/1.1" 200 1042626 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:43:55] "GET /metrics HTTP/1.1" 200 1042626 "" "Prometheus/2.33.4"
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>::ffff:10.8.128.21 - - [08/Sep/2022:07:44:05] "GET /metrics HTTP/1.1" 200 1042642 "" "Prometheus/2.33.4"
>Dashboard Exception
>Traceback (most recent call last):
>  File "/usr/share/ceph/mgr/dashboard/services/exception.py", line 47, in dashboard_exception_handler
>    return handler(*args, **kwargs)
>  File "/lib/python3.9/site-packages/cherrypy/_cpdispatch.py", line 54, in __call__
>    return self.callable(*self.args, **self.kwargs)
>  File "/usr/share/ceph/mgr/dashboard/controllers/_base_controller.py", line 258, in inner
>    ret = func(*args, **kwargs)
>  File "/usr/share/ceph/mgr/dashboard/controllers/_rest_controller.py", line 191, in wrapper
>    return func(*vpath, **params)
>  File "/lib64/python3.9/contextlib.py", line 79, in inner
>    return func(*args, **kwds)
>  File "/lib64/python3.9/contextlib.py", line 79, in inner
>    return func(*args, **kwds)
>  File "/usr/share/ceph/mgr/dashboard/controllers/rbd.py", line 105, in list
>    return self._rbd_list(pool_name)
>  File "/usr/share/ceph/mgr/dashboard/controllers/rbd.py", line 90, in _rbd_list
>    status, value = RbdService.rbd_pool_list(pool)
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 245, in wrapper
>    return rvc.run(fn, args, kwargs)
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 233, in run
>    raise ViewCacheNoDataException()
>dashboard.exceptions.ViewCacheNoDataException: ViewCache: unable to retrieve data
>Error while calling fn=<function RbdService.rbd_pool_list at 0x7ff9cd3f7790> ex=[errno 19] error generating diff from snapshot None
>Traceback (most recent call last):
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 147, in run
>    val = self.fn(*self.args, **self.kwargs)
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 421, in rbd_pool_list
>    stat = cls._rbd_image_stat(
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 386, in _rbd_image_stat
>    return cls._rbd_image(ioctx, pool_name, namespace, image_name)
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 360, in _rbd_image
>    total_prov_bytes, snaps_prov_bytes = cls._rbd_disk_usage(
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 256, in _rbd_disk_usage
>    image.diff_iterate(0, size, prev_snap, du_callb,
>  File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
>  File "rbd.pyx", line 3925, in rbd.Image.diff_iterate
>rbd.OSError: [errno 19] error generating diff from snapshot None
>::ffff:10.8.128.21 - - [08/Sep/2022:07:44:15] "GET /metrics HTTP/1.1" 200 1042544 "" "Prometheus/2.33.4"
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>::ffff:10.8.128.21 - - [08/Sep/2022:07:44:25] "GET /metrics HTTP/1.1" 200 1042544 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:44:35] "GET /metrics HTTP/1.1" 200 1042634 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:44:45] "GET /metrics HTTP/1.1" 200 1042631 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:44:55] "GET /metrics HTTP/1.1" 200 1042631 "" "Prometheus/2.33.4"
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>::ffff:10.8.128.21 - - [08/Sep/2022:07:45:05] "GET /metrics HTTP/1.1" 200 1042642 "" "Prometheus/2.33.4"
>Dashboard Exception
>Traceback (most recent call last):
>  File "/usr/share/ceph/mgr/dashboard/services/exception.py", line 47, in dashboard_exception_handler
>    return handler(*args, **kwargs)
>  File "/lib/python3.9/site-packages/cherrypy/_cpdispatch.py", line 54, in __call__
>    return self.callable(*self.args, **self.kwargs)
>  File "/usr/share/ceph/mgr/dashboard/controllers/_base_controller.py", line 258, in inner
>    ret = func(*args, **kwargs)
>  File "/usr/share/ceph/mgr/dashboard/controllers/_rest_controller.py", line 191, in wrapper
>    return func(*vpath, **params)
>  File "/lib64/python3.9/contextlib.py", line 79, in inner
>    return func(*args, **kwds)
>  File "/lib64/python3.9/contextlib.py", line 79, in inner
>    return func(*args, **kwds)
>  File "/usr/share/ceph/mgr/dashboard/controllers/rbd.py", line 105, in list
>    return self._rbd_list(pool_name)
>  File "/usr/share/ceph/mgr/dashboard/controllers/rbd.py", line 90, in _rbd_list
>    status, value = RbdService.rbd_pool_list(pool)
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 245, in wrapper
>    return rvc.run(fn, args, kwargs)
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 233, in run
>    raise ViewCacheNoDataException()
>dashboard.exceptions.ViewCacheNoDataException: ViewCache: unable to retrieve data
>2022-09-08T07:45:15.764+0000 7ff97ac7e640 -1 librbd::ImageWatcher: 0x56243ca26900 image watch failed: 94713739740160, (107) Transport endpoint is not connected
>2022-09-08T07:45:15.764+0000 7ff97ac7e640 -1 librbd::Watcher: 0x56243ca26900 handle_error: handle=94713739740160: (107) Transport endpoint is not connected
>::ffff:10.8.128.21 - - [08/Sep/2022:07:45:15] "GET /metrics HTTP/1.1" 200 1042682 "" "Prometheus/2.33.4"
>Error while calling fn=<function RbdService.rbd_pool_list at 0x7ff9cd3f7790> ex=[errno 19] error generating diff from snapshot None
>Traceback (most recent call last):
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 147, in run
>    val = self.fn(*self.args, **self.kwargs)
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 421, in rbd_pool_list
>    stat = cls._rbd_image_stat(
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 386, in _rbd_image_stat
>    return cls._rbd_image(ioctx, pool_name, namespace, image_name)
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 360, in _rbd_image
>    total_prov_bytes, snaps_prov_bytes = cls._rbd_disk_usage(
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 256, in _rbd_disk_usage
>    image.diff_iterate(0, size, prev_snap, du_callb,
>  File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
>  File "rbd.pyx", line 3925, in rbd.Image.diff_iterate
>rbd.OSError: [errno 19] error generating diff from snapshot None
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>::ffff:10.8.128.21 - - [08/Sep/2022:07:45:25] "GET /metrics HTTP/1.1" 200 1042682 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:45:35] "GET /metrics HTTP/1.1" 200 1042628 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:45:45] "GET /metrics HTTP/1.1" 200 1042628 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:45:55] "GET /metrics HTTP/1.1" 200 1042607 "" "Prometheus/2.33.4"
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>::ffff:10.8.128.21 - - [08/Sep/2022:07:46:05] "GET /metrics HTTP/1.1" 200 1042743 "" "Prometheus/2.33.4"
>Dashboard Exception
>Traceback (most recent call last):
>  File "/usr/share/ceph/mgr/dashboard/services/exception.py", line 47, in dashboard_exception_handler
>    return handler(*args, **kwargs)
>  File "/lib/python3.9/site-packages/cherrypy/_cpdispatch.py", line 54, in __call__
>    return self.callable(*self.args, **self.kwargs)
>  File "/usr/share/ceph/mgr/dashboard/controllers/_base_controller.py", line 258, in inner
>    ret = func(*args, **kwargs)
>  File "/usr/share/ceph/mgr/dashboard/controllers/_rest_controller.py", line 191, in wrapper
>    return func(*vpath, **params)
>  File "/lib64/python3.9/contextlib.py", line 79, in inner
>    return func(*args, **kwds)
>  File "/lib64/python3.9/contextlib.py", line 79, in inner
>    return func(*args, **kwds)
>  File "/usr/share/ceph/mgr/dashboard/controllers/rbd.py", line 105, in list
>    return self._rbd_list(pool_name)
>  File "/usr/share/ceph/mgr/dashboard/controllers/rbd.py", line 90, in _rbd_list
>    status, value = RbdService.rbd_pool_list(pool)
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 245, in wrapper
>    return rvc.run(fn, args, kwargs)
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 233, in run
>    raise ViewCacheNoDataException()
>dashboard.exceptions.ViewCacheNoDataException: ViewCache: unable to retrieve data
>::ffff:10.8.128.21 - - [08/Sep/2022:07:46:15] "GET /metrics HTTP/1.1" 200 1042610 "" "Prometheus/2.33.4"
>Error while calling fn=<function RbdService.rbd_pool_list at 0x7ff9cd3f7790> ex=[errno 19] error generating diff from snapshot None
>Traceback (most recent call last):
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 147, in run
>    val = self.fn(*self.args, **self.kwargs)
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 421, in rbd_pool_list
>    stat = cls._rbd_image_stat(
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 386, in _rbd_image_stat
>    return cls._rbd_image(ioctx, pool_name, namespace, image_name)
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 360, in _rbd_image
>    total_prov_bytes, snaps_prov_bytes = cls._rbd_disk_usage(
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 256, in _rbd_disk_usage
>    image.diff_iterate(0, size, prev_snap, du_callb,
>  File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
>  File "rbd.pyx", line 3925, in rbd.Image.diff_iterate
>rbd.OSError: [errno 19] error generating diff from snapshot None
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>::ffff:10.8.128.21 - - [08/Sep/2022:07:46:25] "GET /metrics HTTP/1.1" 200 1042610 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:46:35] "GET /metrics HTTP/1.1" 200 1042677 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:46:45] "GET /metrics HTTP/1.1" 200 1042749 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:46:55] "GET /metrics HTTP/1.1" 200 1042749 "" "Prometheus/2.33.4"
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>::ffff:10.8.128.21 - - [08/Sep/2022:07:47:05] "GET /metrics HTTP/1.1" 200 1042822 "" "Prometheus/2.33.4"
>Dashboard Exception
>Traceback (most recent call last):
>  File "/usr/share/ceph/mgr/dashboard/services/exception.py", line 47, in dashboard_exception_handler
>    return handler(*args, **kwargs)
>  File "/lib/python3.9/site-packages/cherrypy/_cpdispatch.py", line 54, in __call__
>    return self.callable(*self.args, **self.kwargs)
>  File "/usr/share/ceph/mgr/dashboard/controllers/_base_controller.py", line 258, in inner
>    ret = func(*args, **kwargs)
>  File "/usr/share/ceph/mgr/dashboard/controllers/_rest_controller.py", line 191, in wrapper
>    return func(*vpath, **params)
>  File "/lib64/python3.9/contextlib.py", line 79, in inner
>    return func(*args, **kwds)
>  File "/lib64/python3.9/contextlib.py", line 79, in inner
>    return func(*args, **kwds)
>  File "/usr/share/ceph/mgr/dashboard/controllers/rbd.py", line 105, in list
>    return self._rbd_list(pool_name)
>  File "/usr/share/ceph/mgr/dashboard/controllers/rbd.py", line 90, in _rbd_list
>    status, value = RbdService.rbd_pool_list(pool)
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 245, in wrapper
>    return rvc.run(fn, args, kwargs)
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 233, in run
>    raise ViewCacheNoDataException()
>dashboard.exceptions.ViewCacheNoDataException: ViewCache: unable to retrieve data
>::ffff:10.8.128.21 - - [08/Sep/2022:07:47:15] "GET /metrics HTTP/1.1" 200 1042716 "" "Prometheus/2.33.4"
>Error while calling fn=<function RbdService.rbd_pool_list at 0x7ff9cd3f7790> ex=[errno 19] error generating diff from snapshot None
>Traceback (most recent call last):
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 147, in run
>    val = self.fn(*self.args, **self.kwargs)
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 421, in rbd_pool_list
>    stat = cls._rbd_image_stat(
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 386, in _rbd_image_stat
>    return cls._rbd_image(ioctx, pool_name, namespace, image_name)
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 360, in _rbd_image
>    total_prov_bytes, snaps_prov_bytes = cls._rbd_disk_usage(
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 256, in _rbd_disk_usage
>    image.diff_iterate(0, size, prev_snap, du_callb,
>  File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
>  File "rbd.pyx", line 3925, in rbd.Image.diff_iterate
>rbd.OSError: [errno 19] error generating diff from snapshot None
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>::ffff:10.8.128.21 - - [08/Sep/2022:07:47:25] "GET /metrics HTTP/1.1" 200 1042716 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:47:35] "GET /metrics HTTP/1.1" 200 1042665 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:47:45] "GET /metrics HTTP/1.1" 200 1042665 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:47:55] "GET /metrics HTTP/1.1" 200 1042727 "" "Prometheus/2.33.4"
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>::ffff:10.8.128.21 - - [08/Sep/2022:07:48:05] "GET /metrics HTTP/1.1" 200 1042766 "" "Prometheus/2.33.4"
>Dashboard Exception
>Traceback (most recent call last):
>  File "/usr/share/ceph/mgr/dashboard/services/exception.py", line 47, in dashboard_exception_handler
>    return handler(*args, **kwargs)
>  File "/lib/python3.9/site-packages/cherrypy/_cpdispatch.py", line 54, in __call__
>    return self.callable(*self.args, **self.kwargs)
>  File "/usr/share/ceph/mgr/dashboard/controllers/_base_controller.py", line 258, in inner
>    ret = func(*args, **kwargs)
>  File "/usr/share/ceph/mgr/dashboard/controllers/_rest_controller.py", line 191, in wrapper
>    return func(*vpath, **params)
>  File "/lib64/python3.9/contextlib.py", line 79, in inner
>    return func(*args, **kwds)
>  File "/lib64/python3.9/contextlib.py", line 79, in inner
>    return func(*args, **kwds)
>  File "/usr/share/ceph/mgr/dashboard/controllers/rbd.py", line 105, in list
>    return self._rbd_list(pool_name)
>  File "/usr/share/ceph/mgr/dashboard/controllers/rbd.py", line 90, in _rbd_list
>    status, value = RbdService.rbd_pool_list(pool)
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 245, in wrapper
>    return rvc.run(fn, args, kwargs)
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 233, in run
>    raise ViewCacheNoDataException()
>dashboard.exceptions.ViewCacheNoDataException: ViewCache: unable to retrieve data
>::ffff:10.8.128.21 - - [08/Sep/2022:07:48:15] "GET /metrics HTTP/1.1" 200 1042636 "" "Prometheus/2.33.4"
>Error while calling fn=<function RbdService.rbd_pool_list at 0x7ff9cd3f7790> ex=[errno 19] error generating diff from snapshot None
>Traceback (most recent call last):
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 147, in run
>    val = self.fn(*self.args, **self.kwargs)
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 421, in rbd_pool_list
>    stat = cls._rbd_image_stat(
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 386, in _rbd_image_stat
>    return cls._rbd_image(ioctx, pool_name, namespace, image_name)
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 360, in _rbd_image
>    total_prov_bytes, snaps_prov_bytes = cls._rbd_disk_usage(
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 256, in _rbd_disk_usage
>    image.diff_iterate(0, size, prev_snap, du_callb,
>  File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
>  File "rbd.pyx", line 3925, in rbd.Image.diff_iterate
>rbd.OSError: [errno 19] error generating diff from snapshot None
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>::ffff:10.8.128.21 - - [08/Sep/2022:07:48:25] "GET /metrics HTTP/1.1" 200 1042636 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:48:35] "GET /metrics HTTP/1.1" 200 1042662 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:48:45] "GET /metrics HTTP/1.1" 200 1042812 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:48:55] "GET /metrics HTTP/1.1" 200 1042812 "" "Prometheus/2.33.4"
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>::ffff:10.8.128.21 - - [08/Sep/2022:07:49:05] "GET /metrics HTTP/1.1" 200 1042688 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:49:15] "GET /metrics HTTP/1.1" 200 1042842 "" "Prometheus/2.33.4"
>Dashboard Exception
>Traceback (most recent call last):
>  File "/usr/share/ceph/mgr/dashboard/services/exception.py", line 47, in dashboard_exception_handler
>    return handler(*args, **kwargs)
>  File "/lib/python3.9/site-packages/cherrypy/_cpdispatch.py", line 54, in __call__
>    return self.callable(*self.args, **self.kwargs)
>  File "/usr/share/ceph/mgr/dashboard/controllers/_base_controller.py", line 258, in inner
>    ret = func(*args, **kwargs)
>  File "/usr/share/ceph/mgr/dashboard/controllers/_rest_controller.py", line 191, in wrapper
>    return func(*vpath, **params)
>  File "/lib64/python3.9/contextlib.py", line 79, in inner
>    return func(*args, **kwds)
>  File "/lib64/python3.9/contextlib.py", line 79, in inner
>    return func(*args, **kwds)
>  File "/usr/share/ceph/mgr/dashboard/controllers/rbd.py", line 105, in list
>    return self._rbd_list(pool_name)
>  File "/usr/share/ceph/mgr/dashboard/controllers/rbd.py", line 90, in _rbd_list
>    status, value = RbdService.rbd_pool_list(pool)
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 245, in wrapper
>    return rvc.run(fn, args, kwargs)
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 233, in run
>    raise ViewCacheNoDataException()
>dashboard.exceptions.ViewCacheNoDataException: ViewCache: unable to retrieve data
>Error while calling fn=<function RbdService.rbd_pool_list at 0x7ff9cd3f7790> ex=[errno 19] error generating diff from snapshot None
>Traceback (most recent call last):
>  File "/usr/share/ceph/mgr/dashboard/tools.py", line 147, in run
>    val = self.fn(*self.args, **self.kwargs)
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 421, in rbd_pool_list
>    stat = cls._rbd_image_stat(
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 386, in _rbd_image_stat
>    return cls._rbd_image(ioctx, pool_name, namespace, image_name)
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 360, in _rbd_image
>    total_prov_bytes, snaps_prov_bytes = cls._rbd_disk_usage(
>  File "/usr/share/ceph/mgr/dashboard/services/rbd.py", line 256, in _rbd_disk_usage
>    image.diff_iterate(0, size, prev_snap, du_callb,
>  File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
>  File "rbd.pyx", line 3925, in rbd.Image.diff_iterate
>rbd.OSError: [errno 19] error generating diff from snapshot None
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/_ping): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.1:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/sysinfo/hostname): [errno: 111] Connection refused
>iscsi REST API failed GET, connection error (url=http://10.1.172.2:5000/api/_ping): [errno: 111] Connection refused
>::ffff:10.8.128.21 - - [08/Sep/2022:07:49:25] "GET /metrics HTTP/1.1" 200 1042842 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:49:35] "GET /metrics HTTP/1.1" 200 1042801 "" "Prometheus/2.33.4"
>::ffff:10.8.128.21 - - [08/Sep/2022:07:49:45] "GET /metrics HTTP/1.1" 200 1042818 "" "Prometheus/2.33.4"
>[root@magna022 yum.repos.d]# 
>

Actions: View

Attachments on bug 2125433: 1910585