Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
This project is now read‑only. Starting Monday, February 2, please use Jira Cloud for all bug tracking management.

Bug 2329994

Summary: [rgw/listing][rfe]: Timeout in list-objects-v2 operation for large bucket listing
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Vidushi Mishra <vimishra>
Component: RGWAssignee: J. Eric Ivancich <ivancich>
Status: CLOSED ERRATA QA Contact: Vidushi Mishra <vimishra>
Severity: urgent Docs Contact: Rivka Pollack <rpollack>
Priority: unspecified    
Version: 7.1CC: ceph-eng-bugs, cephqe-warriors, ivancich, mbenjamin, mkasturi, rpollack, tserlin
Target Milestone: ---Keywords: FutureFeature
Target Release: 9.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: ceph-20.1.0-26 Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2026-01-29 06:53:26 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Vidushi Mishra 2024-12-02 17:36:14 UTC 
Description of problem:

When performing a list-objects-v2 operation for a bucket diagnostic-logs-test1, which is configured with 1999 shards, contains 30 million regular objects, and 1.87 million objects in the _multipart_ namespace, the operation times out after listing approximately 26 million objects. However, when paginated with --max-items set to 1000, 100K, or 3M, the operation completes successfully.

Observed Issue:
----------------

Full listing of the bucket without specifying --max-items fails with the error:
Read from remote host 10.x.x.x: Connection reset by peer  
Connection to 10.x.x.x closed.


Snippet of the timeout
------------------------
[root@depressa017 ~]# date; time aws --endpoint http://10.x.x.x:80 s3api list-objects-v2 --bucket diagnostic-logs-test1
.
.
.

        {
            "Key": "data/N27/good/193_tasking/2024-10-31/25/compacted-part-f55a5b45-f11f-4dd7-91e0-79658ca61548-0-26403402",
            "LastModified": "2024-11-28T07:56:01.077Z",
            "ETag": "\"d17951d5ae5b47977b774563ada908f1\"",
            "Size": 4000,
            "StorageClass": "STANDARD"
        },
        {
            "Key": "data/N27/good/193_tasking/2024-10-31/25/compacted-part-f55a5b45-f11f-4dd7-91e0-79658ca61548-0-26403403",
            "LastModified": "2024-11-28T07:56:01.470Z",
            "ETag": "\"343f3b027b7ee6929eba593c1a38a259\"",
            "Size": 4000,
            "StorageClass": "STANDARD"
        },
        {
            "Key": "data/N27/good/193_tasking/2024-10-31/25/compacted-part-f55a5b45-f11f-4dd7-91e0-79658ca61548-0-26403404",
            "LastModified": "2024-11-28T07:56:01.518Z",
            "ETag": "\"7d1e589a7ea6c1946a893c77227b62f4\"",
            "Size": 4000,
            "StorageClass": "STANDARD"
        },
        {
            "Key": "data/N27/good/193_tasking/2024-10-31/25/compacted-part-f55a5b45-f11f-4dd7-91e0-79658ca61548-0-26403405",
            Read from remote host 10.x.x.x: Connection reset by peer
Connection to 10.x.x.x closed.


Bucket Stats
---------------------

[root@depressa016 ~]# date; radosgw-admin bucket stats --bucket diagnostic-logs-test1 | egrep 'bucket|id|owner|shards|objects'
Mon Dec  2 03:30:22 PM UTC 2024
    "bucket": "diagnostic-logs-test1",
    "num_shards": 1999,
    "id": "019a4b7a-9ed6-444e-8eef-30e6292ef70b.254317.1",
    "owner": "user1",
            "num_objects": 30000000
            "num_objects": 1871018
    "bucket_quota": {
        "max_objects": -1


The issue arises after processing approximately 26 million objects.

Command Used:

- Full Listing (Fails):

aws --endpoint http://10.x.x.x:80 s3api list-objects-v2 --bucket diagnostic-logs-test1

- Paginated Listing (Successful):

aws --endpoint http://10.x.x.x:80 s3api list-objects-v2 --bucket diagnostic-logs-test1 --max-items <1000|100000|3000000>

Version-Release number of selected component (if applicable):
ceph version 18.2.1-229.0.hotfix.bz2327880.el9cp (1b5b765b240e2172c930f14b762fcd7a11147e50) reef (stable)": 28

How reproducible:

seen on this bucket 3/3

Steps to Reproduce:
1. 
2.
3.

Actual results:


Expected results:


Additional info:
Comment 10 errata-xmlrpc 2026-01-29 06:53:26 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: Red Hat Ceph Storage 9.0 Security and Enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2026:1536