Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
This project is now read‑only. Starting Monday, February 2, please use Jira Cloud for all bug tracking management.

Bug 2356271

Summary: CephFS-NFS - mounted nfs shares overestimate/show wrong filesystem sizes on the mount
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Goutham Pacha Ravi <gouthamr>
Component: NFS-GaneshaAssignee: Frank Filz <ffilz>
Status: CLOSED DUPLICATE QA Contact: Manisha Saini <msaini>
Severity: medium Docs Contact:
Priority: unspecified    
Version: 7.2CC: cephqe-warriors, kkeithle
Target Milestone: ---   
Target Release: 8.1z3   
Hardware: All   
OS: All   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2025-08-27 22:27:36 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Goutham Pacha Ravi 2025-03-31 17:27:09 UTC
Description of problem:

This bug was reported against openstack-manila as: https://issues.redhat.com/browse/OSPRH-13323

When you create a 10GB NFS share with manila and mount it to a system,  the size shown on the client is 1.3TB

The quota on the underlying CephFS filesystem is in place and we cannot write to the nfs share more then 10GB.



cjanisze@fedora-vm ~/D/p/o/manila-share> openstack share list --insecure --project chrisj
+--------------------------------------+-------+------+-------------+-----------+-----------+-----------------+----------------------------+-------------------+
| ID                                   | Name  | Size | Share Proto | Status    | Is Public | Share Type Name | Host                       | Availability Zone |
+--------------------------------------+-------+------+-------------+-----------+-----------+-----------------+----------------------------+-------------------+
| 99b2f52b-3454-4966-8164-9cc8f34c547f | test1 |   10 | NFS         | available | False     | nfs             | hostgroup@cephfsnfs#cephfs | nova              |
+--------------------------------------+-------+------+-------------+-----------+-----------+-----------------+----------------------------+-------------------+


cjanisze@fedora-vm ~/D/p/o/manila-share [2]> openstack share show 99b2f52b-3454-4966-8164-9cc8f34c547f --insecure
+---------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Field                                 | Value                                                                                                             |
+---------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| access_rules_status                   | active                                                                                                            |
| availability_zone                     | nova                                                                                                              |
| create_share_from_snapshot_support    | False                                                                                                             |
| created_at                            | 2025-01-23T15:05:37.658014                                                                                        |
| description                           | None                                                                                                              |
| export_locations                      |                                                                                                                   |
|                                       | id = e2c3278c-8aee-4d47-8568-1951da2f0447                                                                         |
|                                       | path = 172.20.138.250:/volumes/_nogroup/d78c21fa-dba3-4c08-9f3b-505eeebf84ac/73ad23f3-300a-426e-b7cf-6ffa53010cff |
|                                       | preferred = True                                                                                                  |
|                                       | share_instance_id = d78c21fa-dba3-4c08-9f3b-505eeebf84ac                                                          |
|                                       | is_admin_only = False                                                                                             |
| has_replicas                          | False                                                                                                             |
| host                                  | hostgroup@cephfsnfs#cephfs                                                                                        |
| id                                    | 99b2f52b-3454-4966-8164-9cc8f34c547f                                                                              |
| is_public                             | False                                                                                                             |
| is_soft_deleted                       | False                                                                                                             |
| mount_snapshot_support                | False                                                                                                             |
| name                                  | test1                                                                                                             |
| progress                              | 100%                                                                                                              |
| project_id                            | 1e7b48f0eadd4dcd951e87bb961e15e8                                                                                  |
| properties                            |                                                                                                                   |
| replication_type                      | None                                                                                                              |
| revert_to_snapshot_support            | False                                                                                                             |
| scheduled_to_be_deleted_at            | None                                                                                                              |
| share_group_id                        | None                                                                                                              |
| share_network_id                      | None                                                                                                              |
| share_proto                           | NFS                                                                                                               |
| share_server_id                       | None                                                                                                              |
| share_type                            | a8e2fb0e-d59e-4b2d-8c7f-fa79e1618c38                                                                              |
| share_type_name                       | nfs                                                                                                               |
| size                                  | 10                                                                                                                |
| snapshot_id                           | None                                                                                                              |
| snapshot_support                      | False                                                                                                             |
| source_share_group_snapshot_member_id | None                                                                                                              |
| status                                | available                                                                                                         |
| task_state                            | None                                                                                                              |
| user_id                               | b41657d7d4134f8c907d1f6bda32e934                                                                                  |
| volume_type                           | nfs                                                                                                               |
+---------------------------------------+-------------------------------------------------------------------------------------------------------------------+


[root@rhel94-vm1 ~]# mount -t nfs 172.20.138.250:/volumes/_nogroup/d78c21fa-dba3-4c08-9f3b-505eeebf84ac/73ad23f3-300a-426e-b7cf-6ffa53010cff  /mnt


[root@rhel94-vm1 ~]# df -h
Filesystem                                                                                                  Size  Used Avail Use% Mounted on
devtmpfs                                                                                                    4.0M     0  4.0M   0% /dev
tmpfs                                                                                                       888M     0  888M   0% /dev/shm
tmpfs                                                                                                       356M  9.7M  346M   3% /run
/dev/vda4                                                                                                   8.8G  1.5G  7.3G  17% /
/dev/vda3                                                                                                   960M  170M  791M  18% /boot
/dev/vda2                                                                                                   200M  7.1M  193M   4% /boot/efi
tmpfs                                                                                                       178M     0  178M   0% /run/user/0
tmpfs                                                                                                       178M     0  178M   0% /run/user/1000
172.20.138.250:/volumes/_nogroup/d78c21fa-dba3-4c08-9f3b-505eeebf84ac/73ad23f3-300a-426e-b7cf-6ffa53010cff  1.3T     0  1.3T   0% /mnt

[root@rhel94-vm1 mnt]# for i in {1..11}; do dd if=/dev/zero of=/mnt/test$i.img bs=1G count=1 oflag=dsync; done
1+0 records in
1+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 2.75783 s, 389 MB/s
1+0 records in
1+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.64177 s, 295 MB/s
1+0 records in
1+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 2.87453 s, 374 MB/s
1+0 records in
1+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.04324 s, 353 MB/s
1+0 records in
1+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 2.58057 s, 416 MB/s
1+0 records in
1+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 2.83895 s, 378 MB/s
1+0 records in
1+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 2.57254 s, 417 MB/s
1+0 records in
1+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 2.63475 s, 408 MB/s
1+0 records in
1+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 2.66892 s, 402 MB/s
1+0 records in
1+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 2.64982 s, 405 MB/s
dd: error writing '/mnt/test11.img': Disk quota exceeded
1+0 records in
0+0 records out
0 bytes copied, 1.57725 s, 0.0 kB/s


[root@rhel94-vm1 mnt]# df -h
Filesystem                                                                                                  Size  Used Avail Use% Mounted on
devtmpfs                                                                                                    4.0M     0  4.0M   0% /dev
tmpfs                                                                                                       888M     0  888M   0% /dev/shm
tmpfs                                                                                                       356M  9.7M  346M   3% /run
/dev/vda4                                                                                                   8.8G  1.5G  7.3G  17% /
/dev/vda3                                                                                                   960M  170M  791M  18% /boot
/dev/vda2                                                                                                   200M  7.1M  193M   4% /boot/efi
tmpfs                                                                                                       178M     0  178M   0% /run/user/0
tmpfs                                                                                                       178M     0  178M   0% /run/user/1000
172.20.138.250:/volumes/_nogroup/d78c21fa-dba3-4c08-9f3b-505eeebf84ac/73ad23f3-300a-426e-b7cf-6ffa53010cff  1.3T   10G  1.3T   1% /mnt


 [root@edpm-compute-0 ceph]# ceph fs subvolume info cephfs d78c21fa-dba3-4c08-9f3b-505eeebf84ac
{
    "atime": "2025-01-23 15:05:38",
    "bytes_pcent": "0.00",
    "bytes_quota": 10737418240,
    "bytes_used": 15,
    "created_at": "2025-01-23 15:05:38",
    "ctime": "2025-01-23 15:09:45",
    "data_pool": "cephfs.cephfs.data",
    "features": [
        "snapshot-clone",
        "snapshot-autoprotect",
        "snapshot-retention"
    ],
    "flavor": 2,
    "gid": 0,
    "mode": 16895,
    "mon_addrs": [
        "172.20.142.100:6789",
        "172.20.142.102:6789",
        "172.20.142.101:6789"
    ],
    "mtime": "2025-01-23 15:09:45",
    "path": "/volumes/_nogroup/d78c21fa-dba3-4c08-9f3b-505eeebf84ac/73ad23f3-300a-426e-b7cf-6ffa53010cff",
    "pool_namespace": "fsvolumens_d78c21fa-dba3-4c08-9f3b-505eeebf84ac",
    "state": "complete",
    "type": "subvolume",
    "uid": 0
}


Version-Release number of selected component (if applicable): 


- Ceph Version rhceph:7-493
- NFS-Ganesha package versions:
nfs-utils-2.5.4-27.el9.x86_64
nfs-ganesha-selinux-5.7-5.el9cp.noarch
nfs-ganesha-5.7-5.el9cp.x86_64
nfs-ganesha-rgw-5.7-5.el9cp.x86_64
nfs-ganesha-ceph-5.7-5.el9cp.x86_64
nfs-ganesha-rados-grace-5.7-5.el9cp.x86_64
nfs-ganesha-rados-urls-5.7-5.el9cp.x86_64


How reproducible: Always


Steps to Reproduce:
1. Create an OpenStack Manila share (CephFS subvolume) of size X GiB
2. Allow client access to share (Export the subvolume via NFS)
3. Mount the share on a linux host and use "df -h" on the mounted filesystem

Actual results:

The "size" attribute under df shows a much larger size than the quota of the share in question; the "used" attribute shows all the quota as being "used" even on a seemingly empty share. Due to this disparity, the "used %" is incorrect/useless. 



Expected results:

The "size" attribute must reflect the quota allocated to the subvolume, and the "used" attribute must reflect the space consumed by files within the subvolume.

Comment 1 Goutham Pacha Ravi 2025-08-27 22:27:36 UTC
This bug is a duplicate; see progress and further comments on https://bugzilla.redhat.com/show_bug.cgi?id=2248613

*** This bug has been marked as a duplicate of bug 2248613 ***