Bug 1685406 - Proper error message needed for FUSE mount failure when /var is filled.
Summary: Proper error message needed for FUSE mount failure when /var is filled.
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Gluster Storage
Classification: Red Hat Storage
Component: glusterfs
Version: rhgs-3.4
Hardware: x86_64
OS: Linux
low
low
Target Milestone: ---
: RHGS 3.5.z Batch Update 1
Assignee: Sheetal Pamecha
QA Contact: Mugdha Soni
URL:
Whiteboard:
Depends On: 1688068
Blocks:
TreeView+ depends on / blocked
 
Reported: 2019-03-05 06:46 UTC by Kshithij Iyer
Modified: 2020-01-30 06:43 UTC (History)
5 users (show)

Fixed In Version: glusterfs-6.0-23
Doc Type: No Doc Update
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-01-30 06:42:47 UTC
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2020:0288 0 None None None 2020-01-30 06:43:02 UTC

Description Kshithij Iyer 2019-03-05 06:46:53 UTC
Description of problem:
On a gluster client, if we try to mount volume when /var is filled completely FUSE mount fails with:
################################################################################
# mount.glusterfs dhcp35-137.lab.eng.blr.redhat.com:/testvol_replicated/ bug/
ERROR: failed to create logfile "/var/log/glusterfs/bug-.log" (No space left on device)
ERROR: failed to open logfile /var/log/glusterfs/bug-.log
Mount failed. Please check the log file for more details.
################################################################################

Instead of which a proper error message should be displayed like:
################################################################################
# mount.glusterfs dhcp35-137.lab.eng.blr.redhat.com:/testvol_replicated/ bug/
ERROR: failed to create logfile "/var/log/glusterfs/bug-.log" (No space left on device)
ERROR: failed to open logfile /var/log/glusterfs/bug-.log
Mount failed as no space left on device please free disk space. 
################################################################################
As the present error message is misleading.

Version-Release number of selected component (if applicable):
glusterfs-3.12.2-45

How reproducible:
1/1

Steps to Reproduce:
1. Create one volume of any type and start it. 
2. On the client node fill /var/log using fallocate.
3. Try to mount the volume on the client.

Comment 2 Amar Tumballi 2019-03-08 06:42:39 UTC
> # mount.glusterfs dhcp35-137.lab.eng.blr.redhat.com:/testvol_replicated/ bug/
> ERROR: failed to create logfile "/var/log/glusterfs/bug-.log" (No space left on device)

Doesn't the above line capture the 'issue' at hand? The reason this is giving a generic 'Mount failed' log at the end is because when the process fails, it fails with -1, and we are not having a tool in bash to log the error message itself. Hence we believe the output is good enough.

Comment 3 Amar Tumballi 2019-03-12 11:39:04 UTC
Kshithij, With the above explanation, I am inclined towards closing the bug as WONTFIX.

Comment 4 Kshithij Iyer 2019-03-12 12:04:15 UTC
> > # mount.glusterfs dhcp35-137.lab.eng.blr.redhat.com:/testvol_replicated/ bug/
> > ERROR: failed to create logfile "/var/log/glusterfs/bug-.log" (No space left on device)
> 
> Doesn't the above line capture the 'issue' at hand?
In that case I would not want the error message "Mount failed. Please check the log file for more details." to be displayed at all. Because it would create confusion for when read by the user.

Comment 5 Amar Tumballi 2019-03-13 04:08:56 UTC
https://review.gluster.org/22346

Comment 10 Mugdha Soni 2019-12-05 09:39:36 UTC
Tested with the following :
1. glusterfs-server-6.0-23.el7rhgs.x86_64
2.3.10.0-1062.7.1.el7.x86_64

The steps to reproduce mentioned in description were followed  and the following observations were seen:-

1. [root@dhcp46-69 log]# df -Th
Filesystem     Type      Size  Used Avail Use% Mounted on
devtmpfs       devtmpfs   16G     0   16G   0% /dev
tmpfs          tmpfs      16G     0   16G   0% /dev/shm
tmpfs          tmpfs      16G  9.0M   16G   1% /run
tmpfs          tmpfs      16G     0   16G   0% /sys/fs/cgroup
/dev/sda1      xfs       100G  1.8G   99G   2% /
/dev/sdb1      xfs       200G  200G  100K 100% /var
tmpfs          tmpfs     3.2G     0  3.2G   0% /run/user/0

The /var/log is filled and volume was mounted on client . Following error messages were seen :-

[root@dhcp46-69 mnt]# mount -t glusterfs 10.70.46.182:/vol1 /mnt/vol1
ERROR: failed to create logfile "/var/log/glusterfs/mnt-vol1.log" (No space left on device)
ERROR: failed to open logfile /var/log/glusterfs/mnt-vol1.log
Mounting glusterfs on /mnt/vol1 failed.

The changes were done.
Hence moving the bug to verified state.

Comment 12 errata-xmlrpc 2020-01-30 06:42:47 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:0288


Note You need to log in before you can comment on or make changes to this bug.