Bug 1367641

Summary: Centos nodes out of action
Product: [Community] GlusterFS Reporter: Nigel Babu <nigelb>
Component: project-infrastructureAssignee: Nigel Babu <nigelb>
Status: CLOSED CURRENTRELEASE QA Contact:
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: mainlineCC: bugs, gluster-infra, mscherer
Target Milestone: ---Keywords: Triaged
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-08-17 05:18:28 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Nigel Babu 2016-08-17 04:56:22 UTC 
The following Centos Nodes are out of action:

slave20.cloud.gluster.org
slave21.cloud.gluster.org
slave27.cloud.gluster.org

Bring them back online.
Comment 1 Nigel Babu 2016-08-17 05:00:57 UTC 
slave20 and slave21 needed hard reboots.
Comment 2 Nigel Babu 2016-08-17 05:18:28 UTC 
slave27 was out of space. /var/log/messages-20160809 was the offending file. It was 22 GB :|
Comment 3 M. Scherer 2016-08-17 12:53:07 UTC 
Mhh, something start to  spew debug logs ?
Comment 4 Nigel Babu 2016-08-17 15:51:54 UTC 
I wish I actually kept a copy instead of deleting. Next time I'll try to push the log somewhere so we can do a quick analysis.