Bug 479585 - Review Request: megaupload-dl - Megaupload automatic downloader
Summary: Review Request: megaupload-dl - Megaupload automatic downloader
Keywords:
Status: CLOSED DEFERRED
Alias: None
Product: Fedora
Classification: Fedora
Component: Package Review
Version: rawhide
Hardware: All
OS: Linux
medium
medium
Target Milestone: ---
Assignee: Jochen Schmitt
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2009-01-11 18:45 UTC by Marek Mahut
Modified: 2009-09-24 19:43 UTC (History)
7 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2009-03-02 09:31:34 UTC
Type: ---
Embargoed:


Attachments (Terms of Use)
mail from legal (1.47 KB, text/plain)
2009-01-12 19:51 UTC, Marek Mahut
no flags Details
blender wrapper script (1.72 KB, text/plain)
2009-01-21 19:01 UTC, Jochen Schmitt
no flags Details

Description Marek Mahut 2009-01-11 18:45:33 UTC
Spec URL: http://mmahut.fedorapeople.org/reviews/megaupload-dl/megaupload-dl.spec
SRPM URL: http://mmahut.fedorapeople.org/reviews/megaupload-dl/megaupload-dl-0.1.3-1.fc8.src.rpm
Koji build: http://koji.fedoraproject.org/koji/taskinfo?taskID
Description: Megaupload-dl helps on the painful process of downloading
files hosted on the popular Megaupload site if you don't have
a premium account. The process is completely automatic as the
captcha is recognized using a OCR. The script
(run from the command line, there is no GUI) only returns the file link;
use your favorite web downloader to actually get the file.

Comment 1 Marek Mahut 2009-01-11 18:46:32 UTC
Koji build: http://koji.fedoraproject.org/koji/taskinfo?taskID=1045389

Comment 2 Pavel Alexeev 2009-01-11 19:57:15 UTC
Excuse me, will it include Rapidshare downloader ( http://code.google.com/p/megaupload-dl/wiki/RapidShare ) as part of upstream megaupload-dl project ?

Comment 3 Jochen Schmitt 2009-01-11 20:13:24 UTC
Good:
+ RPMlist is silent on source rpm.
+ Basename of the SPEC file fit the package name.
+ Consistent usage fo rpm macros
+ %doc section is small, so no sepearte doc subpackage is require.
+ Tar Ball match with upstream tar ball:
(md5sum: 8a03cafa72888565f48cf100150c004a)
+ Files sections contains no files or directories which belongs to othe packages.

Bad:
- Package should contains the BRs to python a python-BeautifulSoup.
- Place remove the argument from the get_python_lib funcstion, so you should wrote:
%{!?python_sitelib: %define python_sitelib %(%{__python} -c "from distutils.sysconfig import get_python_lib; print get_python_lib()")}
- Please put 
%{python_sitelib}/megaupload*
into the %files section, so the egg-info file may be includes into your package.
- Please a 'BuildArch: noarch' on your package, because it's doesn't contains archtiecture depending contents.
- Con't verfiy License tag of the package.
- Not any source files of the package contains a copyright notice.
- package contains no verbatin copy of the license text.
(I have open a but on the upstream website. Please refer to http://code.google.com/p/megaupload-dl/issues/detail?id=2)
- Rpmlint complaints on binary rpm:
megaupload-dl.noarch: E: non-executable-script /usr/lib/python2.5/site-packages/megaupload_dl/lib.py 0644
megaupload-dl.noarch: W: spurious-executable-perm /usr/share/doc/megaupload-dl-0.1.3/megaupload_dl_wget.sh
megaupload-dl.noarch: E: non-executable-script /usr/lib/python2.5/site-packages/megaupload_dl/megaupload_dl.py 0644

Comment 4 Marek Mahut 2009-01-11 20:27:31 UTC
You're too quick sorry :) That wasn't final SRPM I've built in koji, but it is uploaded now.

Spec URL:
http://mmahut.fedorapeople.org/reviews/megaupload-dl/megaupload-dl.spec
SRPM URL:
http://mmahut.fedorapeople.org/reviews/megaupload-dl/megaupload-dl-0.1.3-1.fc8.src.rpm

Comment 5 Jochen Schmitt 2009-01-11 20:40:28 UTC
OK, the local build works fine now, But you should really add a 'BuildArch: noarch' on your package, because it's doesn't contains any archtecture depending content.

The complaints of rpmlint agains the binary rpm sill exist. The same issue are the licensing issues because the sources contains no copyright notive and the upstream package contains no verbatin copy of the license text. Even of the project homepage i couldN't find any hint about the licensing state of the package. for will emphasis, taht this is a very severe issue.

At last: Please increase the release counter if you are releasing a new source rpm.

Comment 6 Jochen Schmitt 2009-01-11 20:46:03 UTC
I have take a second look of the project homepage. On the right magin I have found the information, that the package is copyrighted on the GPLv3. This is a valid open source license for the Fedora project. But the issue of the missing copyright notices in the source files sill exist.

Comment 7 Jochen Schmitt 2009-01-11 20:47:44 UTC
I have take a second look of the project homepage. On the right magin I have found the information, that the package is copyrighted on the GPLv3. This is a valid open source license for the Fedora project. But the issue of the missing copyright notices in the source files sill exist.

Comment 8 Marek Mahut 2009-01-11 20:52:20 UTC
Jochen,

- noarch package done
- I tihnk rpmlint warnings can be ignored here, we don't need exec permission on these python scripts (they are called from the main script) - do you think it's an issue to have that doc script executable?
- I've contacted legal team, to find out if it's ok to include this package in Fedora, as it could be in violation of DCMA

Comment 10 Marek Mahut 2009-01-11 20:53:48 UTC
(In reply to comment #2)
> Excuse me, will it include Rapidshare downloader (
> http://code.google.com/p/megaupload-dl/wiki/RapidShare ) as part of upstream
> megaupload-dl project ?

We may package repidshare downloader later, in different package.

Comment 11 Jochen Schmitt 2009-01-11 21:28:19 UTC
Upstream has notified me, that a release 0.2 is available now. But unfortunately not all complainted copyrigh related issue are fixed.

Comment 12 Marek Mahut 2009-01-11 21:35:20 UTC
New SRPM uploaded. http://mmahut.fedorapeople.org/reviews/megaupload-dl/

Comment 13 Marek Mahut 2009-01-12 19:49:28 UTC
Jochen,

Cleared issue with legal team, we are good to go, I'll attach mail from legal later.

http://mmahut.fedorapeople.org/reviews/megaupload-dl/megaupload-dl-0.2-2.fc8.src.rpm

Comment 14 Marek Mahut 2009-01-12 19:51:11 UTC
Created attachment 328778 [details]
mail from legal

Comment 15 Jochen Schmitt 2009-01-13 17:33:07 UTC
It will be nice, if you can create a SRPM of release 0.2.1. On this release all source files should contains a copyright notice.

Comment 17 Jochen Schmitt 2009-01-14 16:05:05 UTC
Good:
+ Package name fit with nameing guidelines
+ Name of SPEC file fit with basename of package
+ Package has a valid open source license
+ Package contains verbatin copy of the license text
+ Consistently usage of macros
+ source can be downloaded via spectool
+ Tar ball in the package fits with upstreams
(md5sum: 366849faf106f4fdfb6e1ff1f72b9e9d)
* BUILDROOT will cleaned on the beginning of the %install and %clean stanza
+ Rpmlint is quiete on source rpm
+ Package contains no subpackages
+ Files containing in the package doesn't belongs to others
+ Content of %doc is small, so no separate subpackage is require
+ Package will be built on noarch
+ Local build works fine
+ Build on koji works fine
+ Local install works fine
+ Starting of application without argument works
+ Removing of the package works fine.

Bad:
- License tag should be CPLv3+ because the copyright notice
on the source files allow the usage of later version of the GPL
- Rpmlint complaints on binary rpm:
megaupload-dl.noarch: W: spurious-executable-perm /usr/share/doc/megaupload-dl-0.2.1/megaupload_dl_wget.sh
megaupload-dl.noarch: E: non-executable-script /usr/lib/python2.5/site-packages/megaupload_dl/lib.py 0644
megaupload-dl.noarch: E: non-executable-script /usr/lib/python2.5/site-packages/megaupload_dl/megaupload_dl.py 0644
- Files on %{_sitedir}/metagupload_dl/*.py should be executables
- Files on %{_docdir} should be not executable
- __init__.py file should have a shebang

Comment 18 Marek Mahut 2009-01-14 17:38:11 UTC
(In reply to comment #17)
> - Files on %{_sitedir}/metagupload_dl/*.py should be executables

Why?

> - __init__.py file should have a shebang

Why?

Comment 19 Jochen Schmitt 2009-01-14 18:10:22 UTC
Plese refer to

https://fedoraproject.org/wiki/Packaging/Guidelines#Libexecdir

Because the complaints files contains executable code, the files perms should set for allow executing of this files.

Comment 20 Jochen Schmitt 2009-01-21 17:45:04 UTC
PIng.

Comment 21 Jochen Schmitt 2009-01-21 19:01:10 UTC
Created attachment 329637 [details]
blender wrapper script

I have create a fixed release of the blender-wrapper script. It may be nice, if you can try out this script.

If the script is ok, I will include it in the next release of the blender package.

Comment 22 Jochen Schmitt 2009-01-26 20:22:27 UTC
??? There was somethin going wrong with me. Please ignore comment #21

Comment 23 Jochen Schmitt 2009-02-04 19:34:50 UTC
Ping mmahut

Comment 24 Marek Mahut 2009-02-16 16:07:21 UTC
(In reply to comment #19)
> Plese refer to
> 
> https://fedoraproject.org/wiki/Packaging/Guidelines#Libexecdir
> 
> Because the complaints files contains executable code, the files perms should
> set for allow executing of this files.

These files are scripts used from the main executable script. I don't think they should be executable - nobody will never execute it separately. Looking in my site-packages directory, no files is set as executable. Also, only very few __init__.py files starts with shebang.

Comment 25 Lubomir Rintel 2009-02-26 20:13:26 UTC
Marek,

MegaUpload rapidly changes captchas these days, so this no longer works.
And are you sure this is a build-time dependency:

BuildRequires:  tesseract

Hint: It's not. And probably also this:

BuildRequires:  python-imaging

Comment 26 Marek Mahut 2009-02-26 20:48:48 UTC
I know about the captcha, upstream is working on that, many users complains that it's not even human readable and I've bought a premium account.

Comment 27 Lubomir Rintel 2009-02-26 21:00:21 UTC
"Let's wait some time." [1] doesn't sound like upstream is working on that. Seriously, are they waiting for megaupload to replace captcha with a machine-readable one? Why would they do that?

[1] http://code.google.com/p/plowshare/issues/detail?id=6

Comment 28 Marek Mahut 2009-02-27 07:01:10 UTC
(In reply to comment #27)
> Why would they do that?

Because they are nice people?

Comment 29 Marek Mahut 2009-03-02 09:31:34 UTC
We will re-open this bug once upstream fix it.

Comment 30 Arnau Sánchez 2009-03-06 22:12:00 UTC
Hi, I'm the developer of megaupload-dl. 

>> Seriously, are they waiting for megaupload to replace captcha with a
>> machine-readable one? 

> Because they are nice people?  

:-D 

No, we (I) considered that the new captcha was sometimes even hard for a human and then they would eventually change it again (since the first 4-char captcha lasted only one week) in deference to their poor users. 

Time has proved me wrong, so I implemented a (somewhat clumsy) OCR in my other project, plowshare (http://code.google.com/p/plowshare/)

Now, 2 things to say:

- Megaupload-dl version 0.3 supports the new captcha (and the upload script works again).

- Do you consider droping megaupload_dl and switching to plowshare? It has far more features...

thanks!

Comment 31 Marek Mahut 2009-03-07 06:58:45 UTC
Hello Arnau,

Great! I'll try to package plowshare next week - thank you.

Comment 32 Arnau Sánchez 2009-03-12 21:13:17 UTC
The Megaupload guys have heard us ;-) The new captcha is very, very easy for tesseract.

Uploaded new version 0.3.1

Comment 33 Arnau Sánchez 2009-04-13 11:28:01 UTC
Megaupload changed again the captcha some weeks ago (4 letters, rotated and overlapped). Both plowshare and megaupload-dl support it.

Comment 34 Paulo Fidalgo 2009-09-19 20:36:23 UTC
I agree in using plowshare instead, I'm using and I'm very satisfied with it.


Note You need to log in before you can comment on or make changes to this bug.