| Summary: | Concatenating files with dd and append causes differing md5sums | ||
|---|---|---|---|
| Product: | [Community] GlusterFS | Reporter: | Vikas Gorur <vikas> |
| Component: | write-behind | Assignee: | Raghavendra G <raghavendra> |
| Status: | CLOSED DUPLICATE | QA Contact: | |
| Severity: | high | Docs Contact: | |
| Priority: | urgent | ||
| Version: | 3.0.4 | CC: | aavati, anush, gluster-bugs, vijay |
| Target Milestone: | --- | ||
| Target Release: | --- | ||
| Hardware: | x86_64 | ||
| OS: | Linux | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | Bug Fix | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | Type: | --- | |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
Removing write-behind or replicate fixes the problem. List of all configurations tested, and whether bug was reproducible with that config: volgen configuration - yes distribute + replicate - no wb + distribute + replicate - yes wb + replicate - yes wb + distribute - no Setup is 4-node distribute + replicate, volgen configuration, version 3.0.4:
- Create 4 files:
# for i in {1..4}; do dd if=/dev/urandom of=file.$i bs=128k count=1000; done
- Concatenate into output file:
# for i in {1..4}; do dd if=file.$i bs=128k >> out.1; done
- Again:
# for i in {1..4}; do dd if=file.$i bs=128k >> out.2; done
- Use cat to concatenate:
# cat file.* > out.3
# cat file.* > out.4
# cat file.* >> out.5
- Checksums:
# md5sum out.*
a560a5790b7e24a5223c110bcbae64d0 out.1
5395a61d6fd5076b64d88217fffafe06 out.2
ca9ba81d87501031bff112cda2de4a8e out.3
ca9ba81d87501031bff112cda2de4a8e out.4
d53f4951df61bcb119b3d4b3b6b4786a out.5
This appears to be the bug with vsftpd bug. Please check with 3.0.5 Checked with 3.0.5. Seems like it is fixed ccb30ef6b4d6419d3df5ddbd5ecdb313 out.1 ccb30ef6b4d6419d3df5ddbd5ecdb313 out.2 ccb30ef6b4d6419d3df5ddbd5ecdb313 out.3 ccb30ef6b4d6419d3df5ddbd5ecdb313 out.4 ccb30ef6b4d6419d3df5ddbd5ecdb313 out.5 Please mark this as duplicate of the vsftpd bug if you are sure it is the same. |
The problem is not with reading: for i in {1..4}; do cat file.$i |md5sum; done 15cdd10ef39660c46e9d41bd3ffb6e7f - 6ca3b305243714aaad415d986e708e71 - 541f83e9ec9379d5a93340a1e1228a04 - e2ea13af407a13847d79b9aea8cf90a1 - for i in {1..4}; do cat file.$i |md5sum; done 15cdd10ef39660c46e9d41bd3ffb6e7f - 6ca3b305243714aaad415d986e708e71 - 541f83e9ec9379d5a93340a1e1228a04 - e2ea13af407a13847d79b9aea8cf90a1 - Reading gives the same data each time.