Bug 762792 (GLUSTER-1060) - Concatenating files with dd and append causes differing md5sums
Summary: Concatenating files with dd and append causes differing md5sums
Keywords:
Status: CLOSED DUPLICATE of bug 762666
Alias: GLUSTER-1060
Product: GlusterFS
Classification: Community
Component: write-behind
Version: 3.0.4
Hardware: x86_64
OS: Linux
urgent
high
Target Milestone: ---
Assignee: Raghavendra G
QA Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2010-07-12 23:31 UTC by Vikas Gorur
Modified: 2010-07-14 06:09 UTC (History)
4 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed:
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:


Attachments (Terms of Use)

Description Vikas Gorur 2010-07-12 20:33:20 UTC
The problem is not with reading:

for i in {1..4}; do cat file.$i |md5sum; done
15cdd10ef39660c46e9d41bd3ffb6e7f  -
6ca3b305243714aaad415d986e708e71  -
541f83e9ec9379d5a93340a1e1228a04  -
e2ea13af407a13847d79b9aea8cf90a1  -

for i in {1..4}; do cat file.$i |md5sum; done
15cdd10ef39660c46e9d41bd3ffb6e7f  -
6ca3b305243714aaad415d986e708e71  -
541f83e9ec9379d5a93340a1e1228a04  -
e2ea13af407a13847d79b9aea8cf90a1  -

Reading gives the same data each time.

Comment 1 Vikas Gorur 2010-07-12 20:45:40 UTC
Removing write-behind or replicate fixes the problem.

List of all configurations tested, and whether bug was reproducible with that config:

volgen configuration - yes
distribute + replicate - no
wb + distribute + replicate - yes
wb + replicate - yes
wb + distribute - no

Comment 2 Vikas Gorur 2010-07-12 23:31:32 UTC
Setup is 4-node distribute + replicate, volgen configuration, version 3.0.4:

- Create 4 files:

# for i in {1..4}; do dd if=/dev/urandom of=file.$i bs=128k count=1000; done

- Concatenate into output file:

# for i in {1..4}; do dd if=file.$i bs=128k >> out.1; done

- Again:

# for i in {1..4}; do dd if=file.$i bs=128k >> out.2; done

- Use cat to concatenate:

# cat file.* > out.3
# cat file.* > out.4
# cat file.* >> out.5

- Checksums:

# md5sum out.*

a560a5790b7e24a5223c110bcbae64d0  out.1
5395a61d6fd5076b64d88217fffafe06  out.2
ca9ba81d87501031bff112cda2de4a8e  out.3
ca9ba81d87501031bff112cda2de4a8e  out.4
d53f4951df61bcb119b3d4b3b6b4786a  out.5

Comment 3 Anand Avati 2010-07-13 02:48:49 UTC
This appears to be the bug with vsftpd bug. Please check with 3.0.5

Comment 4 Anush Shetty 2010-07-13 03:14:48 UTC
Checked with 3.0.5. Seems like it is fixed 

ccb30ef6b4d6419d3df5ddbd5ecdb313  out.1
ccb30ef6b4d6419d3df5ddbd5ecdb313  out.2
ccb30ef6b4d6419d3df5ddbd5ecdb313  out.3
ccb30ef6b4d6419d3df5ddbd5ecdb313  out.4
ccb30ef6b4d6419d3df5ddbd5ecdb313  out.5

Comment 5 Vikas Gorur 2010-07-13 03:20:37 UTC
Please mark this as duplicate of the vsftpd bug if you are sure it is the same.

Comment 6 Vijay Bellur 2010-07-14 03:09:02 UTC

*** This bug has been marked as a duplicate of bug 934 ***


Note You need to log in before you can comment on or make changes to this bug.