如何在谷歌云存储中获取 GS_SECRET_ACCESS_KEY 和 GS_ACCESS_KEY_ID

Question

I try to read data from public google cloud storage ( https://console.cloud.google.com/storage/browser/gcp-public-data-landsat ) with Landsat images.

I use for it Python3 with GDAL. But I have an error

ERROR 15: GS_SECRET_ACCESS_KEY+GS_ACCESS_KEY_ID, GS_OAUTH2_REFRESH_TOKEN or GOOGLE_APPLICATION_CREDENTIALS or GS_OAUTH2_PRIVATE_KEY+GS_OAUTH2_CLIENT_EMAIL configuration options and /home/qwerty/.boto not defined

How can I get GS_SECRET_ACCESS_KEY and GS_ACCESS_KEY_ID?

Answer 1

gs_access_key_id and gs_secret_access_key can be generated by

1.navigating to your Google Cloud Storage console and clicking on Settings .

2.on the Settings page, navigate to the Interoperability tab.

3.on this page you can now choose a service account and click Create a new key to generate an access key and a matching secret.

Output:

New service account HMAC key
service-account@project.iam.gserviceaccount.com
Access key  
xxxxxxxxxxxxxxxxxxx
Secret  
xxxxxxxxxxxxxxxxxxx
Copy this key's secret if you'll need it in the future. Once you close this dialog, the secret can't be recovered.

Answer 2

An alternative authentication approach to reading and optionally writing GeoTIF in GCS.

In CGP Console

• Create a Service Account and download a JSON keyfile. Keep it safe.
• On the Storage Bucket browser, Permission tab, give the new Service Account Roles for:
  • Storage Legacy Bucket Owner and
  • Storage Legacy Bucket Reader
  • path_to_credentials points to your key file

    GEOTIF_PATH = "/vsigs/<my-bucket>/<objectname>"

    with rasterio.Env(GOOGLE_APPLICATION_CREDENTIALS=path_to_credentials):
        with rasterio.open('{}'.format(GEOTIF_PATH)) as src:
            print(src.width, src.height)
            profile = src.profile
            print(profile)

Answer 3

Following up on intotecho answer, I use this snippet to automatically set the application default credentials globally

import os

import rasterio
from google.auth import _cloud_sdk, environment_vars


def get_application_default_credentials_path() -> str:
    explicit_file = os.environ.get(environment_vars.CREDENTIALS)
    if explicit_file:
        return explicit_file
    # check if application default credentials exist.
    credentials_filename = _cloud_sdk.get_application_default_credentials_path()
    if credentials_filename:
        return credentials_filename
    return None


def set_application_default_credentials():
    app_default_creds_path = get_application_default_credentials_path()
    if app_default_creds_path:
        rasterio.Env(GOOGLE_APPLICATION_CREDENTIALS=app_default_creds_path)