Files of any sizes have to be supported. AFAIK pulp is now limited by POST request size. Uploading by chunks should also help when an upload fails. Retransmitting a single chunk is definitely cheaper than re-uploading the whole file.
Uploading big files (600M) fails with a memory error: Traceback (most recent call last): File "./pulp-admin", line 147, in ? admin.main() File "/var/www/django/pulp/src/pulp/client/cli/base.py", line 98, in main command.main(args[1:]) File "/var/www/django/pulp/src/pulp/client/core/base.py", line 118, in main action.main(args[1:]) File "/var/www/django/pulp/src/pulp/client/core/base.py", line 231, in main self.run() File "/var/www/django/pulp/src/pulp/client/core/package.py", line 293, in run pkgstream = base64.b64encode(open(frpm).read()) File "/usr/lib/python2.4/base64.py", line 53, in b64encode encoded = binascii.b2a_base64(s)[:-1] MemoryError
Build: 0.140
Would it be feasible not to use base64? That would boost upload speed by 30% at least.
Yes. Done. Good suggestion.
verified [root@preethi ~]# rpm -q pulp pulp-0.0.144-1.fc14.noarch [root@preethi ~]# pulp-admin content upload -r upload2 /root/iso/Fedora-14-x86_64-Live-Desktop.iso --help Usage: pulp-admin <options> content upload <options> Options: -h, --help show this help message and exit --dir=DIR process content from this directory -r REPOIDS, --repoid=REPOIDS Optional repoid, to associate the uploaded content --nosig pushes unsigned content(rpms) --chunksize=CHUNK chunk size to use for uploads. Default:10485760 -v, --verbose verbose output. [root@preethi ~]# pulp-admin content upload -r upload2 /root/iso/Fedora-14-x86_64-Live-Desktop.iso --chunksize=20485760 -v * Starting Package Upload * Performing Package Uploads to Pulp server Package [Fedora-14-x86_64-Live-Desktop.iso] already exists on the server with checksum [8f81741e938924f68965b5dceac7013d72fe875725b53f61bebd36e740f79b99] * Performing Repo Associations Package association Complete for Repo [upload2]: Packages: None Files: Fedora-14-x86_64-Live-Desktop.iso * Content Upload complete. [root@preethi ~]#
Closing with current community release pulp-0.0.223