Bug 1082043

Summary:	[SNAPSHOT]: gluster snapshot status timesout without displaying the output when snaps are >150
Product:	[Red Hat Storage] Red Hat Gluster Storage	Reporter:	Rahul Hinduja <rhinduja>
Component:	snapshot	Assignee:	Sachin Pandit <spandit>
Status:	CLOSED ERRATA	QA Contact:	Rahul Hinduja <rhinduja>
Severity:	urgent	Docs Contact:
Priority:	urgent
Version:	rhgs-3.0	CC:	nsathyan, rhs-bugs, spandit, ssamanta, storage-qa-internal
Target Milestone:	---
Target Release:	RHGS 3.0.0
Hardware:	x86_64
OS:	Linux
Whiteboard:	SNAPSHOT
Fixed In Version:	glusterfs-3.6.0.13-1	Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:
Clones:	1087676 (view as bug list)		Environment:
Last Closed:	2014-09-22 19:32:50 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	1087676

Description Rahul Hinduja 2014-03-28 14:28:40 UTC

Description of problem:
=======================

When in a system if the number of snaps are more (my case 200) the snapshot status command fails as:

[root@snapshot-09 ~]# 
[root@snapshot-09 ~]# gluster snapshot status
Snapshot command failed
[root@snapshot-09 ~]#

If I am not wrong the CLI (gluster snapshot status) gets timed out(~2min) before it gathers the detail information of all the 200 snaps to print in output.

When number of snapshots are less(my other case 50), the snapshot status returns the output.

Version-Release number of selected component (if applicable):
=============================================================

glusterfs-3.4.1.7.snap.mar27.2014git-1.el6.x86_64


How reproducible:
=================
1/1

Steps to Reproduce:
1. Create 4 node clustered system
2. Create and start 4 volumes (vol0 to vol3)
3. Create 50 snapshot on each volume (total 200 snapshots)
4. use gluster snapshot status

Actual results:
===============

[root@snapshot-09 ~]# gluster snapshot status
Snapshot command failed
[root@snapshot-09 ~]#


Expected results:
=================

Command should be successful and it should output the status of snapshots.


Additional info:
================

Log:

[2014-03-28 07:12:19.972979] I [rpc-clnt.c:965:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600
[2014-03-28 07:12:19.973111] I [socket.c:3534:socket_init] 0-management: SSL support is NOT enabled
[2014-03-28 07:12:19.973154] I [socket.c:3549:socket_init] 0-management: using system polling thread
[2014-03-28 07:16:04.945617] W [glusterd-snapshot.c:4619:glusterd_snapshot_postvalidate] 0-management: invalid snap command
[2014-03-28 07:16:05.079233] I [socket.c:3134:socket_submit_reply] 0-socket.management: not connected (priv->connected = -1)
[2014-03-28 07:16:05.079272] E [rpcsvc.c:1206:rpcsvc_submit_generic] 0-rpc-service: failed to submit message (XID: 0x1, Program: GlusterD svc cli, ProgVers: 2, Proc: 39) to rpc-transport (socket.management)
[2014-03-28 07:16:05.079314] E [glusterd-utils.c:384:glusterd_submit_reply] 0-: Reply submission failed
[2014-03-28 07:16:56.326815] W [glusterd-snapshot.c:4619:glusterd_snapshot_postvalidate] 0-management: invalid snap command

Comment 2 Nagaprasad Sathyanarayana 2014-04-21 06:17:45 UTC

Marking snapshot BZs to RHS 3.0.

Comment 3 Nagaprasad Sathyanarayana 2014-05-19 10:56:19 UTC

Setting flags required to add BZs to RHS 3.0 Errata

Comment 4 Sachin Pandit 2014-06-05 07:02:23 UTC

Patch which fixes this issue is posted downstream, But due to
the missing of blocker flag its not yet merged.

Comment 5 Sachin Pandit 2014-06-05 07:02:56 UTC

https://code.engineering.redhat.com/gerrit/#/c/25996/

Comment 6 Rahul Hinduja 2014-06-09 09:20:26 UTC

Verified with build: glusterfs-3.6.0.14-1.el6rhs.x86_64

Had 920 snaps in a system

[root@rhs-arch-srv2 ~]# gluster snapshot list | wc
    920     920    4308
[root@rhs-arch-srv2 ~]# time gluster snapshot status | grep "Snap Name :" | wc
    920    3680   15348

real	5m21.571s
user	0m0.670s
sys	0m0.209s
[root@rhs-arch-srv2 ~]# 


Snapshot status prints all of them.


[root@inception ~]# gluster snapshot status | grep "Snap Name :"
Snap Name : a27
Snap Name : a28
Snap Name : a29
Snap Name : a30
Snap Name : a31
Snap Name : a32
Snap Name : a33
Snap Name : d27
Snap Name : c27
Snap Name : b27
Snap Name : a34
Snap Name : d28
Snap Name : c28
Snap Name : a35
: : : : : : : :
: : : : : : : :
: : : : : : : :

Moving the bug to verified state

Comment 8 errata-xmlrpc 2014-09-22 19:32:50 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

http://rhn.redhat.com/errata/RHEA-2014-1278.html