Run Pylint for all Python files in a directory and all subdirectories

Question

I have

find . -iname "*.py" -exec pylint -E {} ;\

and

FILES=$(find . -iname "*.py")
pylint -E $FILES

If I understand correctly, the first command will run pylint for each of the Python files, the second one will run pylint once for all files. I expected that both commands would return the same output, but they return different results. I think this diff is somehow related to imports and F (failure) pylint messages, which occurs when a import fails and is not output by pylint -E.

Has someone already experienced this and could explain why the diff happens and what is the best way to run pylint?

Answer 1

Just pass the directory name to the pylint command. To lint all files in ./server :

pylint server

Answer 2

My one cent

find . -type f -name "*.py" | xargs pylint 

How does it work?

find finds all files ends with py and pass to xargs , xargs runs pylint command on each file.

NOTE: You can give any argument to pylint command as well.

EDIT:

According to doc we can use

1. pylint mymodule.py

2. pylint directory/mymodule.py

3. pylint ./module

number 2 will work if the directory is a python package (ie has an __init__.py file or it is an implicit namespace package) or if the “directory” is in the python path.

Answer 3

To run pylint on all *.py files in a directory and its subdirectories, you can run:

shopt -s globstar  # for Bash
pylint ./**/*.py

Answer 4

To run Pylint on all code in Git version control,

pylint $(git ls-files '*.py')

This is very fast, as Git already knows the names of all of your files. It also works on macOS which lacks Bash 4. However it won't lint files that are very new and haven't been git add ed to the repos yet.

My thanks to national treasure Julia Evans for the git ls-files trick -- here's her original use case, automating workflows with "entr": https://jvns.ca/blog/2020/06/28/entr/

Answer 5

pytest with pytest-pylint can trivially run pylint on all Python files:

In your setup.cfg file in the root directory of your project, ensure you have at minimum:

[tool:pytest]
addopts = --pylint 

Next, run pytest on the command line.

Answer 6

[UPDATED based on helpful additions in the comments]

If you don't have an __init__.py file in the directory, and you don't want to for various reasons, my approach is

touch __init__.py; pylint $(pwd); rm __init__.py

If you already have a __init__.py file in that directory, it will be deleted .

If you find yourself needing this functionality often, you should make a function that does this in a safer way that preserves a pre-existing __init__.py file. For example, you could put the following pylint_all_the_things function in your ~/.bashrc file. (The last line exports the function so it can be called from any subshell.) If you don't want to edit .bashrc , you could put the function body in an executable shell script file.

This function defaults to running pylint in your current directory, but you can specify the directory to use as the 1st function argument.

# Run pylint in a given directory, defaulting to the working directory
pylint_all_the_things() {
    local d=${1:-$(pwd)}

    # Abort if called with a non-directory argument.
    if [ ! -d "${d}" ]; then
        echo "Not a directory: ${d}"
        echo "If ${d} is a module or package name, call pylint directly"
        exit 1
    fi

    local module_marker="${d}/__init__.py"

    # Cleanup function to later remove __init__.py if it doesn't currently exist
    [[ ! -f ${module_marker} ]] && local not_a_module=1
    cleanup() {
        (( ${not_a_module:-0} == 1 )) && rm "${module_marker}"
    }
    trap cleanup EXIT

    # Create __init__.py if it doesn't exist
    touch "${module_marker}"
    pylint "${d}"
    cleanup
}
export -f pylint_all_the_things

The trap utility is used to ensure the cleanup happens even if the call to pylint fails and you have set -e enabled, which causes the function to exit before reaching the cleanup line.

If you want to call pylint recursively on the current working directory and all subfolders, you could do something like

for dir in ./**/ ; do pylint_all_the_things "$dir"; done

Which will require globstar to be enabled in bash ( shopt -s globstar ).

Answer 7

我在根目录下使用：

pylint *

Answer 8

您是否尝试过探矿者（ https://pypi.org/project/prospector/ ）或 pylint_runner（ https://pypi.org/project/pylint_runner/ ）

Answer 9

如果您想运行您的自定义配置文件，请使用以下命令

pylint --rcfile=.pylintrc <directory_name>

Answer 10

There is already an issue for this and hopefully gets fixed soon.

If you do not prefer to use xargs you can just do a plain find-exec:

find . -type f -name "*.py" -exec pylint -j 0 --exit-zero {} \;

The problem I had with pylint Project-Dir is that all the absolute imports were not working.

Answer 11

Im using the "pylint_runner" in order to run pylint on all files in the directory and the subdirectories. Python 3.7.4

pylint_runner 0.54

pylint 2.4.1

https://pypi.org/project/pylint_runner/

Here is the command to run it from the Docker container:

docker run -i --rm --name my_container \
  -v "$PWD":"$PWD" -w "$PWD" \
    python:3.7 \
      /bin/sh -c "pip3 install -r requirements.txt; pylint_runner -v"

requirements.txt - should exist in the "$PWD" directory and contain "pylint_runner" entry.

Answer 12

If your goal is to run pylint on all files in the current working directory and subfolders, here is one workaround. This script runs pylint on the current directory. If __init__.py does not exist, it creates it, runs pylint, then removes it.

#! /bin/bash -
if [[ ! -e __init__.py ]]; then
    touch __init__.py
    pylint `pwd`
    rm __init__.py
else
    pylint `pwd`
fi

Answer 13

To run Pylint in all subdirectories,

pylint $(find [a-z]* -type d)

This solution is simpler and more direct than others. It works with no setup, including on macOS which doesn't have Bash 4.

The reason for the [az]* is because most projects have Git or other magic subdirectories, which would pollute the results. If you have subdirectories starting with Capital Letters, use this variant:

pylint $(find [a-zA-Z]* -type d)

Answer 14

using./server or something similar only works if there is a __init__.py in all subdirs, it will not match all python files in all subdirs. using find and xargs is an option, but this also works:

pylint **py

Answer 15

1. touch __init__.py in the current directory
2. touch __init__.py in every subdirectory that you want pylint to look at
3. pylint $(pwd) (or equivalently pylint /absolute/path/to/current/directory )

Answer 16

The pylint docs makes mention of a --recursive flag, which tells pylint to find all modules and packages by itself without needing the user to manually specify all of them.

Therefore, all you need to do is:

pylint --recursive=y .

Looks like the flag was introduced in pylint v2.13.0 , but it seems that from v2.15.0 onwards, you won't need the --recursive flag, and that will be pylint's default behaviour.