Bug 879592
| Summary: | cannot upload large file with curl over scp | ||||||
|---|---|---|---|---|---|---|---|
| Product: | Red Hat Enterprise Linux 6 | Reporter: | Karel Srot <ksrot> | ||||
| Component: | curl | Assignee: | Kamil Dudka <kdudka> | ||||
| Status: | CLOSED ERRATA | QA Contact: | Karel Srot <ksrot> | ||||
| Severity: | medium | Docs Contact: | |||||
| Priority: | high | ||||||
| Version: | 6.3 | CC: | jjaburek, luhaisheng0301, ovasik | ||||
| Target Milestone: | rc | ||||||
| Target Release: | --- | ||||||
| Hardware: | i386 | ||||||
| OS: | Unspecified | ||||||
| Whiteboard: | |||||||
| Fixed In Version: | curl-7.19.7-33.el6 | Doc Type: | Bug Fix | ||||
| Doc Text: |
Cause:
libcurl used the old libssh2 API for uploading files over SCP, which limited the maximum size of files being transferred on 32bit architectures.
Consequence:
The 32bit packages of libcurl were not able to transfer large files over SCP.
Fix:
The code of libcurl has been changed to use the new libssh2 API for SCP upload, which does not suffer from such a limitation.
Result:
libcurl can now upload large files over SCP.
|
Story Points: | --- | ||||
| Clone Of: | Environment: | ||||||
| Last Closed: | 2013-02-21 10:09:49 UTC | Type: | Bug | ||||
| Regression: | --- | Mount Type: | --- | ||||
| Documentation: | --- | CRM: | |||||
| Verified Versions: | Category: | --- | |||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||
| Embargoed: | |||||||
| Bug Depends On: | |||||||
| Bug Blocks: | 881827 | ||||||
| Attachments: |
|
||||||
forgot to mention that I could reproduce the issue on i386, other architectures transferred the file properly. upstream commits: https://github.com/bagder/curl/commit/f8cf037e https://github.com/bagder/curl/commit/992ceae3 Created attachment 650441 [details]
backport of the above mentioned upstream commits
This request was evaluated by Red Hat Product Management for inclusion in a Red Hat Enterprise Linux release. Product Management has requested further review of this request by Red Hat Engineering, for potential inclusion in a Red Hat Enterprise Linux release for currently deployed products. This request is not yet committed for inclusion in a release. Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. http://rhn.redhat.com/errata/RHBA-2013-0393.html |
Description of problem: Found an issue with uploading large file via scp on i386. After 1GB of data is transmitted the connection somehow stucks and the ammount of transferred data doesn't increase anymore. looks like this: % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 1026M 0 6443k --:--:-- 0:02:43 --:--:-- 0 It is not a regression, same issue happens with libssh2, curl, libcurl from rhel6.3. Version-Release number of selected component (if applicable): libssh2-1.4.2-1.el6.i686 libcurl-7.19.7-32.el6.i686 curl-7.19.7-32.el6.i686 How reproducible: always Steps to Reproduce: 1. prepare huge file, ~2GB or so 2. prepare test user and ssh keys 3. # curl -T ~curltestuser/hugefile -u curltestuser: --key /root/.ssh/id_rsa --pubkey /root/.ssh/id_rsa.pub scp://localhost/home/curltestuser/uploadedfile Actual results: around 1GB of data is transfered and from that moment the destination file doesn't grow anymore # ls -l ~curltestuser/uploadedfile -rw-r--r--. 1 curltestuser curltestuser 57835520 Nov 23 11:53 /home/curltestuser/uploadedfile # ls -l ~curltestuser/uploadedfile -rw-r--r--. 1 curltestuser curltestuser 81035264 Nov 23 11:53 /home/curltestuser/uploadedfile # ls -l ~curltestuser/uploadedfile -rw-r--r--. 1 curltestuser curltestuser 106610688 Nov 23 11:53 /home/curltestuser/uploadedfile # ls -l ~curltestuser/uploadedfile -rw-r--r--. 1 curltestuser curltestuser 138182656 Nov 23 11:53 /home/curltestuser/uploadedfile # ls -l ~curltestuser/uploadedfile -rw-r--r--. 1 curltestuser curltestuser 154959872 Nov 23 11:53 /home/curltestuser/uploadedfile # ls -l ~curltestuser/uploadedfile -rw-r--r--. 1 curltestuser curltestuser 182255616 Nov 23 11:53 /home/curltestuser/uploadedfile # ls -l ~curltestuser/uploadedfile -rw-r--r--. 1 curltestuser curltestuser 1073741824 Nov 23 11:54 /home/curltestuser/uploadedfile # ls -l ~curltestuser/uploadedfile -rw-r--r--. 1 curltestuser curltestuser 1073741824 Nov 23 11:54 /home/curltestuser/uploadedfile # ls -l ~curltestuser/uploadedfile -rw-r--r--. 1 curltestuser curltestuser 1073741824 Nov 23 11:54 /home/curltestuser/uploadedfile Expected results: whole file is transferred Additional info: