| Summary: | performance issues for distribute-replicate volume on AMI-AWS | ||
|---|---|---|---|
| Product: | [Community] GlusterFS | Reporter: | Saurabh <saurabh> |
| Component: | replicate | Assignee: | tcp |
| Status: | CLOSED NOTABUG | QA Contact: | |
| Severity: | low | Docs Contact: | |
| Priority: | low | ||
| Version: | 3.1.2 | CC: | gluster-bugs, vijay, vikas |
| Target Milestone: | --- | ||
| Target Release: | --- | ||
| Hardware: | All | ||
| OS: | Linux | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | Bug Fix | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | Type: | --- | |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
|
Description
Saurabh
2011-02-03 11:58:19 UTC
When the performance measurements are being made, can we collect the following statistics on the client and the server for every run and the entire duration of the run? [for both the baseline (AWS in this case) and the test run (AMI-AWS)] 1. iostat -xcdhn 5 2. ethstats [you can get this via apt-get] 3. mpstat -A 5 (also run - "cat /proc/interrupts" once and save the output). 4. vmstat 5 More questions to add to those from Pavan: - How many servers? - Which AMI/distribution are you using for the AWS case? - Are the EBS volumes in the AWS case RAID'ed? The performance of EBS volumes can vary considerably from instance to instance. Can you also get baseline numbers for the export directories in each case by running: dd if=/dev/zero of=/export/directory/file bs=1M count=512 oflag=direct Capturing iostat will also help answer this question. Finally, are you trying to figure out from these tests how the AMI version of GlusterFS compares to just regular GlusterFS installed on an EC2 instance? Do you have any reason to believe there will be a difference? (In reply to comment #2) > More questions to add to those from Pavan: > > - How many servers? > - Which AMI/distribution are you using for the AWS case? > - Are the EBS volumes in the AWS case RAID'ed? > > The performance of EBS volumes can vary considerably from instance to instance. > Can you also get baseline numbers for the export directories in each case by > running: > > dd if=/dev/zero of=/export/directory/file bs=1M count=512 oflag=direct > > Capturing iostat will also help answer this question. > > Finally, are you trying to figure out from these tests how the AMI version of > GlusterFS compares to just regular GlusterFS installed on an EC2 instance? Do > you have any reason to believe there will be a difference? To answer your question above, I think the baseline in this test was using CentOS. The statistics will hopefully indicate at the bottlenecks. But what concerns me is the degree of variation. Pavan After running another round of perf tests (baseline on AWS with Centos and the test run on Gluster AMI), the results were very different from what led Saurabh to raise this bug. But what comes out very clearly is that there is a possibility of high variation in the perf numbers. For some tests, I see ~4x variation from one setup to the other, even though the system configurations (of both setups) are more or less the same. NOTE: No EBS was used for this test run. I think this bug can be closed. I'd like to hear from Saurabh on this matter before closing it out. The detailed logs and some scripts to perform statistics collection on servers remotely are available. They are a bit bulky to be attached. If there are people interested in taking a look, please send me an email regarding the same and I'll send the logs/scripts. Pavan As mentioned in the previous update, the results are not consistently reproducible. This is not a bug. |