[英]How to upload a file to Google Cloud Storage on Python 3?
How can I upload a file to Google Cloud Storage from Python 3?如何将文件从 Python 3 上传到Google Cloud Storage ? Eventually Python 2, if it's infeasible from Python 3.
最终 Python 2,如果从 Python 3 不可行。
I've looked and looked, but haven't found a solution that actually works.我看了又看,但还没有找到真正有效的解决方案。 I tried boto , but when I try to generate the necessary.boto file through
gsutil config -e
, it keeps saying that I need to configure authentication through gcloud auth login
.我试过boto ,但是当我尝试通过
gsutil config -e
生成 necessary.boto 文件时,它一直说我需要通过gcloud auth login
配置身份验证。 However, I have done the latter a number of times, without it helping.但是,我已经多次完成后者,但没有帮助。
Use the standard gcloud library, which supports both Python 2 and Python 3.使用支持 Python 2 和 Python 3 的标准gcloud库。
from gcloud import storage
from oauth2client.service_account import ServiceAccountCredentials
import os
credentials_dict = {
'type': 'service_account',
'client_id': os.environ['BACKUP_CLIENT_ID'],
'client_email': os.environ['BACKUP_CLIENT_EMAIL'],
'private_key_id': os.environ['BACKUP_PRIVATE_KEY_ID'],
'private_key': os.environ['BACKUP_PRIVATE_KEY'],
}
credentials = ServiceAccountCredentials.from_json_keyfile_dict(
credentials_dict
)
client = storage.Client(credentials=credentials, project='myproject')
bucket = client.get_bucket('mybucket')
blob = bucket.blob('myfile')
blob.upload_from_filename('myfile')
A simple function to upload files to a gcloud bucket.将文件上传到 gcloud 存储桶的简单功能。
from google.cloud import storage
def upload_to_bucket(blob_name, path_to_file, bucket_name):
""" Upload data to a bucket"""
# Explicitly use service account credentials by specifying the private key
# file.
storage_client = storage.Client.from_service_account_json(
'creds.json')
#print(buckets = list(storage_client.list_buckets())
bucket = storage_client.get_bucket(bucket_name)
blob = bucket.blob(blob_name)
blob.upload_from_filename(path_to_file)
#returns a public url
return blob.public_url
You can generate a credential file using this link: https://cloud.google.com/storage/docs/reference/libraries?authuser=1#client-libraries-install-python您可以使用此链接生成凭证文件: https : //cloud.google.com/storage/docs/reference/libraries?authuser=1#client-libraries-install-python
Asynchronous Example:异步示例:
import asyncio
import aiohttp
# pip install aiofile
from aiofile import AIOFile
# pip install gcloud-aio-storage
from gcloud.aio.storage import Storage
BUCKET_NAME = '<bucket_name>'
FILE_NAME = 'requirements.txt'
async def async_upload_to_bucket(blob_name, file_obj, folder='uploads'):
""" Upload csv files to bucket. """
async with aiohttp.ClientSession() as session:
storage = Storage(service_file='./creds.json', session=session)
status = await storage.upload(BUCKET_NAME, f'{folder}/{blob_name}', file_obj)
#info of the uploaded file
# print(status)
return status['selfLink']
async def main():
async with AIOFile(FILE_NAME, mode='r') as afp:
f = await afp.read()
url = await async_upload_to_bucket(FILE_NAME, f)
print(url)
# Python 3.6
loop = asyncio.get_event_loop()
loop.run_until_complete(main())
# Python 3.7+
# asyncio.run(main())
Imports the Google Cloud client library (need credentials )导入 Google Cloud 客户端库(需要凭据)
from google.cloud import storage
import os
os.environ["GOOGLE_APPLICATION_CREDENTIALS"]="C:/Users/siva/Downloads/My First Project-e2d95d910f92.json"
Instantiates a client实例化一个客户端
storage_client = storage.Client()
buckets = list(storage_client.list_buckets())
bucket = storage_client.get_bucket("ad_documents")//your bucket name
blob = bucket.blob('/chosen-path-to-object/{name-of-object}')
blob.upload_from_filename('D:/Download/02-06-53.pdf')
print(buckets)
When installing Google Cloud Storage API:安装 Google Cloud Storage API 时:
pip install google-cloud
will throw a ModuleNotFoundError
:将抛出
ModuleNotFoundError
:
from google.cloud import storage
ModuleNotFoundError: No module named 'google'
Make sure you install as in Cloud Storage Client Libraries Docs :确保按照Cloud Storage Client Libraries Docs 中的方式安装:
pip install --upgrade google-cloud-storage
This official repo contains a handful of snippets demonstrating the different ways to upload a file to a bucket: https://github.com/googleapis/python-storage/tree/05e07f248fc010d7a1b24109025e9230cb2a7259/samples/snippets这个官方仓库包含一些片段,展示了将文件上传到存储桶的不同方法: https://github.com/googleapis/python-storage/tree/05e07f248fc010d7a1b24109025e9230cb2a7259/samples/snippets
`` type here: Jav jepanse your text Crounseil `` 在这里输入:Jav jepanse你的文本Crounseil
| Column A | Column B |
| -------- | -------- |
| Cell 1 | Cell 2 | Cell 5
| Cell 3 | Cell 4 | Cell 6
[text](https://www.stackoverflow.com/)| Column A | Column B |
| -------- | -------- |
| Cell 1 | Cell 2 |
| Cell 3 | Cell 4 |
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.