我需要在 docker compose as volume 中设置 aws config 吗？

Question

In my project I need to configure a AWS bucket download as it always gets read time error or connection error when downloading a fairly large file in my deployment. I have a.aws/config in my root directory and in my dockerfile I use "ADD. ." which adds all the files in the project. To build the image I use Docker compose. However, for some reason it is not using the aws config values. Is there a way to pass these values to Docker so that they are actually used?

This is my "config" file which is in ".aws" in the root of the project.

[default]
read_timeout = 1200
connect_timeout = 1200
http_socket_timeout = 1200

s3 =
  max_concurrent_requests = 2
  multipart_threshold = 8MB
  multipart_chunksize = 8MB

My Dockerfile looks like this:

FROM python:3.7.7-stretch AS BASE

RUN apt-get update \
    && apt-get --assume-yes --no-install-recommends install \
        build-essential \
        curl \
        git \
        jq \
        libgomp1 \
        vim

WORKDIR /app

# upgrade pip version
RUN pip install --no-cache-dir --upgrade pip

RUN pip3 install boto3

ADD . .

I expected that through the "ADD. ." boto3 would use the config file. But that is unfortunately not the case.

Answer 1

Perhaps this would answer your question on why the ADD command didn't work. Hidden file.env not copied using Docker COPY

Instead of relying on the local config setting of the machine where the docker image is built, you might want to put in the configuration as an explicit file in your repo, which is copied over to ~/.aws/config or anywhere in the container and referenced by setting its path to AWS_CONFIG_FILE; OR use any one of the the methods defined in the AWS documentation below:

https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html

wherein you can define your configuration as part of your python code or declare them as environment variables