以 minio 作为后端的 Django-Storages S3

Question

i would like to use django-storages with minio so i tryd to adopt settings, configs etc. I found on the web but for some reason my access key or the way it gets provided fails with the following error:

botocore.exceptions.ClientError: An error occurred (InvalidAccessKeyId) when calling the PutObject operation: The AWS Access Key Id you provided does not exist in our records.

if i run manage.py collectstatic

settings.py

#S3 config
STATICFILES_DIRS = [
    os.path.join(BASE_DIR, 'MyProject/static'),
]
AWS_ACCESS_KEY_ID = '9VOWWCTSMX4ZEGVW7N9D'
AWS_SECRET_ACCESS_KEY = 'zJFf9BYWk0TM3FVwyY98UFy0o+DQF0oY1vCXgLqV'
AWS_STORAGE_BUCKET_NAME = 'static'
AWS_S3_CUSTOM_DOMAIN = '127.0.0.1:9000'

AWS_S3_OBJECT_PARAMETERS = {
    'CacheControl': 'max-age=86400',
}

AWS_LOCATION = 'static'
STATIC_URL = 'http://%s/%s/' % (AWS_S3_CUSTOM_DOMAIN, AWS_LOCATION)
STATICFILES_STORAGE = 'storages.backends.s3boto3.S3Boto3Storage'

Is there maybe someone that has already done this?

Answer 1

Here is what I did to get it to work

# settings.py

STATICFILES_STORAGE = 'storages.backends.s3boto3.S3Boto3Storage'

AWS_STORAGE_BUCKET_NAME = 'static'

AWS_ACCESS_KEY_ID = minio_access_key
AWS_SECRET_ACCESS_KEY = minio_secret_key
AWS_S3_ENDPOINT_URL = minio_address (eg. http://localhost:9000)

Versions:

• boto3==1.10.45
• Django==3.0.1
• django-storages==1.8
• Minio==2019-12-26T01:55:09Z (Docker image built from the source code to run on RPi4)

Note: versions were latest when installed using pip install <package>

I didn't attempt to use django-minio-storage since it does not support Django3.

If you have upgraded your package versions, try what I did. If not try setting S3_HOST = '127.0.0.1:9000' .

AWS_S3_ENDPOINT_URL from django-storage docs

AWS_S3_ENDPOINT_URL (optional: default is None, boto3 only )
Custom S3 URL to use when connecting to S3, including scheme. Overrides AWS_S3_REGION_NAME and AWS_S3_USE_SSL . To avoid AuthorizationQueryParametersError error, AWS_S3_REGION_NAME should also be set.

Troubleshooting
Disconnect from the internet and run manage.py collectstatic to see the address to which boto fails to connect.

Answer 2

Why error?

[This is an assumption]: You are trying to access the minio settings/stuff with minio credential . But, the django-storage package using it on aws s3's API.

---

If you are trying to do with minio , you should use minio backed , which is possible by using django-minio-storage

I've implemented the media storage and static storage with the help of django-minio-storage in production, and it's working seamlessly.

---

My django-minio config settings

DEFAULT_FILE_STORAGE = 'minio_storage.storage.MinioMediaStorage'
STATICFILES_STORAGE = 'minio_storage.storage.MinioStaticStorage'
MINIO_STORAGE_ENDPOINT = '127.0.0.1:9000'
MINIO_STORAGE_STATIC_BUCKET_NAME = "static"
STATIC_URL = f'https://{MINIO_STORAGE_ENDPOINT}/{MINIO_STORAGE_STATIC_BUCKET_NAME}/'
MINIO_STORAGE_USE_HTTPS = True
MINIO_STORAGE_AUTO_CREATE_MEDIA_BUCKET = True
MINIO_STORAGE_AUTO_CREATE_STATIC_BUCKET = True

MINIO_STORAGE_ACCESS_KEY = #your ACCESS_KEY
MINIO_STORAGE_SECRET_KEY = # Your SECRET_KEY
MINIO_STORAGE_MEDIA_BUCKET_NAME = "media"