上传大文件时出现 Google Drive API 400 错误

Question

我正在编写一个上传脚本，使用可恢复上传将 CSV 文件上传到 Google Drive 文件夹 - 正在使用它作为参考

https://developers.google.com/api-client-library/python/guide/media_upload

请参阅下面的代码。

它似乎适用于大小 <= 20MB 的文件，但更大的文件会导致问题。

我有一个 43 MB 的 CSV 文件，我试图使用 5 MiB 的块大小上传它，但在最后一个块上传时出现 400 错误：

file_meta = {'title': 'test.csv', 'description': 'Test CSV', 'mimeType': 'text/csv', 'parents': [{'id': myfolder_key}]}
convert_to_Google_Sheets = True
chunk_size = 1024*1024*5
content = <MediaIoBaseUpload object, resumable, 5 MiB chunk size>
req = drive.files().insert(body=file_meta, media_body=content, convert=convert_to_Google_Sheets)
response is None
while not response:
  status, response = req.next_chunk()
  if status:
    print "Uploaded %d%%." % int(status.progress() * 100)

上传似乎进展顺利，直到我们到达最后一个块，当它以 400 错误终止时：

Uploaded 11%.
Uploaded 23%.
Uploaded 34%.
Uploaded 46%.
Uploaded 57%.
Uploaded 69%.
Uploaded 81%.
Uploaded 92%.
Traceback (most recent call last):
  File "<console>", line 2, in <module>
  File "/usr/local/lib/python2.6/dist-packages/oauth2client/util.py", line 137, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "/usr/local/lib/python2.6/dist-packages/googleapiclient/http.py", line 880, in next_chunk
    return self._process_response(resp, content)
  File "/usr/local/lib/python2.6/dist-packages/googleapiclient/http.py", line 907, in _process_response
    raise HttpError(resp, content, uri=self.uri)
HttpError: <HttpError 400 when requesting https://www.googleapis.com/upload/drive/v2/files?uploadType=resumable&convert=true&alt=json returned "Bad Request">

Answer 1

我遇到了同样的问题，并一直认为问题出在文件大小上，但结果证明文件大小只是问题的产物。

问题是每个电子表格 [1] 有 200 万个单元格的限制，当我的（也可能是你的）CSV 文件达到 20MB 左右时，列数 * 行数超过了 200 万个单元格的限制。

[1] https://support.google.com/drive/answer/37603?hl=en