Bug 763761 (GLUSTER-2029)

Summary: create 2 volumes on one single stand-alone server will crash the whole gluster system
Product: [Retired] GlusterSP Reporter: chenmin <chenmin7249>
Component: coreAssignee: Balamurugan Arumugam <bala>
Status: CLOSED CURRENTRELEASE QA Contact:
Severity: high Docs Contact:
Priority: low    
Version: 3.1.0CC: chenmin7249, platform
Target Milestone: 3.1   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Balamurugan Arumugam 2010-10-28 04:06:08 UTC
This problem is observed in low memory systems.  Work around is, Increasing memory or adding swap device/file fixes this problem.  This bug got fixed and available in 3.1.1QA releases.  Let us know your machine configuration.

Comment 1 chenmin 2010-10-28 05:04:05 UTC
(In reply to comment #1)
> This problem is observed in low memory systems.  Work around is, Increasing
> memory or adding swap device/file fixes this problem.  This bug got fixed and
> available in 3.1.1QA releases.  Let us know your machine configuration.

RAM 512M
is it a glusterfs problem or sp defect?

Comment 2 Balamurugan Arumugam 2010-10-28 05:48:47 UTC
Volumes are started using independent glusterfsd/glusterfs processes to increase the performance.  This approach eats up slightly more memory.

This is fixed by adding more swap space at GlusterSP v3.1.1 and glusterfs fix is on the way.

Let us know adding swap helps you to fix this problem.

Comment 3 chenmin 2010-10-28 06:04:50 UTC
(In reply to comment #3)
> Volumes are started using independent glusterfsd/glusterfs processes to
> increase the performance.  This approach eats up slightly more memory.
> 
> This is fixed by adding more swap space at GlusterSP v3.1.1 and glusterfs fix
> is on the way.
> 
> Let us know adding swap helps you to fix this problem.

what's the default swap space in 3.1.0?
is there any way to adjust the swap space?

Comment 4 Balamurugan Arumugam 2010-10-28 06:19:55 UTC
512 MB swap is good enough.  Below is a script which does this automatically.

--- cut here ----
#!/bin/bash

if ! dd if=/dev/zero of=/.swap bs=1M count=512; then
    echo "Failed to create swap file /.swap"
    exit -1
fi

if ! mkswap -f /.swap; then
    echo "Failed to make swap file system on swap file /.swap"
    exit -1
fi

if ! grep -q "^/.swap" /etc/fstab; then
    echo "/.swap     none      swap    sw               0 0" >> /etc/fstab
    swapon /.swap
fi
--- cut here ----

You can login to server using username/password as gluster/glusteradmin and run this script using sudo

Comment 5 chenmin 2010-10-28 06:21:05 UTC
to repeat:
install 3.1.0 initial server
format the server disk
create 1st volume, plain distributed, start it
create 2nd volume, plain distributed, on the same disk, try to start it

result:
firefox dies and quits, can't be started even after reboot.
web services available, but unable to login, and shows no detail information about the system.

never tested dual volumes on mirror or stripe env

Comment 6 Balamurugan Arumugam 2010-10-29 03:07:36 UTC
As we fixed in our code base and will be coming in 3.1.1, I am closing this bug.

Comment 7 chenmin 2010-10-29 06:08:39 UTC
(In reply to comment #6)
> As we fixed in our code base and will be coming in 3.1.1, I am closing this
> bug.

i added more ram and it worked, thanks for your tip