Description of problem: scrapy software just doest work: scrapy startproject tutorial Traceback (most recent call last): File "/usr/bin/scrapy", line 5, in <module> from pkg_resources import load_entry_point File "/usr/lib/python2.7/site-packages/pkg_resources.py", line 2713, in <module> parse_requirements(__requires__), Environment() File "/usr/lib/python2.7/site-packages/pkg_resources.py", line 567, in resolve raise DistributionNotFound(req) pkg_resources.DistributionNotFound: w3lib>=1.8.0 Version-Release number of selected component: python-scrapy-0.24.4-1.fc21 Additional info: reporter: libreport-2.3.0 cmdline: /usr/bin/python2 /usr/bin/scrapy dso_list: python-setuptools-2.0-8.fc21.noarch executable: /usr/bin/scrapy kernel: 3.17.7-300.fc21.x86_64 runlevel: N 5 type: Python uid: 1000 Truncated backtrace: pkg_resources.py:567:resolve:DistributionNotFound: w3lib>=1.8.0 Traceback (most recent call last): File "/usr/bin/scrapy", line 5, in <module> from pkg_resources import load_entry_point File "/usr/lib/python2.7/site-packages/pkg_resources.py", line 2713, in <module> parse_requirements(__requires__), Environment() File "/usr/lib/python2.7/site-packages/pkg_resources.py", line 567, in resolve raise DistributionNotFound(req) DistributionNotFound: w3lib>=1.8.0 Local variables in innermost frame: dist: None to_activate: [Scrapy 0.24.4 (/usr/lib/python2.7/site-packages), six 1.7.3 (/usr/lib/python2.7/site-packages), cssselect 0.9.1 (/usr/lib/python2.7/site-packages), pyOpenSSL 0.13.1 (/usr/lib64/python2.7/site-packages), lxml 3.3.6 (/usr/lib64/python2.7/site-packages), queuelib 1.1.1 (/usr/lib/python2.7/site-packages)] req: Requirement.parse('w3lib>=1.8.0') requirements: [Requirement.parse('Twisted>=10.0.0')] processed: {Requirement.parse('pyOpenSSL'): True, Requirement.parse('six>=1.5.2'): True, Requirement.parse('Scrapy==0.24.4'): True, Requirement.parse('lxml'): True, Requirement.parse('cssselect>=0.9'): True, Requirement.parse('queuelib'): True} env: <pkg_resources.Environment object at 0x7fb531d6ef90> installer: None self: <pkg_resources.WorkingSet object at 0x7fb531d6ee90> best: {'lxml': lxml 3.3.6 (/usr/lib64/python2.7/site-packages), 'pyopenssl': pyOpenSSL 0.13.1 (/usr/lib64/python2.7/site-packages), 'six': six 1.7.3 (/usr/lib/python2.7/site-packages), 'w3lib': None, 'scrapy': Scrapy 0.24.4 (/usr/lib/python2.7/site-packages), 'cssselect': cssselect 0.9.1 (/usr/lib/python2.7/site-packages), 'queuelib': queuelib 1.1.1 (/usr/lib/python2.7/site-packages)}
Created attachment 989812 [details] File: backtrace
Created attachment 989813 [details] File: environ
traceback it is caused because scrapy needs w3lib>=1.8.0 and fedora system-wide it is in 1.3.0, I will talk with the mantainer of w3lib for update and rebuild
python-w3lib-1.11.0-1.fc21 has been submitted as an update for Fedora 21. https://admin.fedoraproject.org/updates/python-w3lib-1.11.0-1.fc21
Package python-w3lib-1.11.0-1.fc21: * should fix your issue, * was pushed to the Fedora 21 testing repository, * should be available at your local mirror within two days. Update it with: # su -c 'yum update --enablerepo=updates-testing python-w3lib-1.11.0-1.fc21' as soon as you are able to. Please go to the following url: https://admin.fedoraproject.org/updates/FEDORA-2015-2110/python-w3lib-1.11.0-1.fc21 then log in and leave karma (feedback).
python-w3lib-1.11.0-1.fc21 has been pushed to the Fedora 21 stable repository. If problems still persist, please make note of it in this bug report.