Read Bash variables into a Python script

Question

I am running a bash script (test.sh) and it loads in environment variables (from env.sh). That works fine, but I am trying to see python can just load in the variables already in the bash script.

#!/bin/bash
source env.sh

echo $test1

python pythontest.py

Answer 1

You need to export the variables in bash, or they will be local to bash:

export test1

Then, in python

import os
print os.environ["test1"]

Answer 2

There's another way using subprocess that does not depend on setting the environment. With a little more code, though.

For a shell script that looks like follows:

#!/bin/sh
myvar="here is my variable in the shell script"

function print_myvar() {
    echo $myvar
}

You can retrieve the value of the variable or even call a function in the shell script like in the following Python code:

import subprocess

def get_var(varname):
    CMD = 'echo $(source myscript.sh; echo $%s)' % varname
    p = subprocess.Popen(CMD, stdout=subprocess.PIPE, shell=True, executable='/bin/bash')
    return p.stdout.readlines()[0].strip()

def call_func(funcname):
    CMD = 'echo $(source myscript.sh; echo $(%s))' % funcname
    p = subprocess.Popen(CMD, stdout=subprocess.PIPE, shell=True, executable='/bin/bash')
    return p.stdout.readlines()[0].strip()

print get_var('myvar')
print call_func('print_myvar')

Note that both shell=True shall be set in order to process the shell command in CMD to be processed as it is, and set executable='bin/bash' to use process substitution, which is not supported by the default /bin/sh .

Answer 3

Assuming the environment variables that get set are permanent, which I think they are not. You can use os.environ .

os.environ["something"]

Answer 4

I created a little library that does this:

https://github.com/aneilbaboo/shellvars-py

Answer 5

If you are trying to source a file, the thing you are missing is set -a . For example, to source env.sh , you would run:

set -a; source env.sh; set +a.

The reason you need this is that bash's variables are local to bash unless they are exported. The -a option instructs bash to export all new variables (until you turn it off with +a). By using set -a before source , all of the variables imported by source will also be exported, and thus available to python.

Credit: this command comes from a comment posted by @chepner as a comment on this answer .

Answer 6

Two additional options, which may or may not help in your specific situation:

#!/bin/bash
source env.sh

echo $test1

set | python pythontest.py