Bug 1584992 - Need python pep8 and other relevant tests in smoke if a patch includes any python file
Summary: Need python pep8 and other relevant tests in smoke if a patch includes any py...
Keywords:
Status: CLOSED UPSTREAM
Alias: None
Product: GlusterFS
Classification: Community
Component: project-infrastructure
Version: mainline
Hardware: Unspecified
OS: Unspecified
low
low
Target Milestone: ---
Assignee: bugs@gluster.org
QA Contact:
URL:
Whiteboard: Process-Automation
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2018-06-01 06:18 UTC by Amar Tumballi
Modified: 2020-03-12 12:52 UTC (History)
5 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-03-12 12:52:47 UTC
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Embargoed:


Attachments (Terms of Use)

Description Amar Tumballi 2018-06-01 06:18:40 UTC
# Description of problem:

There are significant amount of python files in the codebase. There are very good python validation tools to check if the file is all fine.

Also, to make sure the code getting in is python3 compatible, we can automate the tests.

It would be good to run automated pep8 tests and pylint type of tests which can make reviewing much easier on reviewer.

# Additional info:

This job should be able to vote -1 or +1 in smoke.

Comment 1 Nigel Babu 2018-06-01 09:59:31 UTC
Okay, so this can be split into multiple pieces

* Making sure the code is pep8 compliant.
* Making sure the code is pylint compliant.
* Making sure the code is python3 complaint (pylint can do this).

All of these tests can only be voting jobs if we can show that they pass now. Are the current maintainers of these modules willing to spend some time fixing up all the errors in the next few weeks?

Comment 2 Nigel Babu 2018-06-01 10:26:47 UTC
pep8 issues: 3K
pylint issues: 12K
pylint python3 issues: 370

It's not worth running a CI unless we can fix them or tweak the config so we care about the right things.

Comment 3 Aravinda VK 2018-06-08 13:01:28 UTC
pep8 issues can be fixed by using `autopep8` tool, I will work on it and send patch.

pylint gives lot of warnings related to variable naming style, we can ignore those errors. Also pylint errors are mostly about best practices and code suggestions. I feel we should defer pylint voting since it involves lot of code changes.

We can use `flake8` for now to validate pep8, unused variables, imports etc.

https://github.com/gluster/libgfapi-python/blob/master/tox.ini

Comment 4 Nigel Babu 2018-07-03 09:03:09 UTC
So re: python3 validation. I ran pylint --py3k across the codebase today and it showed me zero errors. However, running 2to3 for our python files shows me a lot of dict.iteritems() which should be dict.items() in python3 (Kaleb has a patch to fix them already). This still doesn't catch more subtler bugs like python's division operator changing behavior in python3

python2
5 / 2 = 2

python3
5 / 2 = 2.5

2to3 doesn't catch this change. In essence, we can add automation, but we warned that the automation passing does not actually mean that we're 100% in the clear with regard to python3 support. That will need some in-depth testing and there's no way around that.

Comment 5 Nigel Babu 2018-10-05 08:42:45 UTC
There's a python3 compliance code now, I'm going to add in to sprint 5 to get an initial non-voting job in place for this.

Comment 6 Nigel Babu 2018-10-12 04:06:27 UTC
Whoops, did not assign this to myself before changing status.

Comment 8 Worker Ant 2020-03-12 12:52:47 UTC
This bug is moved to https://github.com/gluster/project-infrastructure/issues/29, and will be tracked there from now on. Visit GitHub issues URL for further details


Note You need to log in before you can comment on or make changes to this bug.