尝试将Google App Engine中的insertAll用于BigQuery时出现HTTP 501错误

Question

Solved: As Felipe suggested in the comments, I'm using EU as data location. Streaming is not usable in EU data centers for BigQuery and therefore I had to migrate my data to US data centers, after which everything worked as intended.

My question: I'm trying to use Google App Engine (python version) to push data to BigQuery. Everything seems fine until the actual insert happens, after which I get a HTTP 501 error. Google's error code sheet refers me to "Contact support".

Error response:
HttpError: https://www.googleapis.com/bigquery/v2/projects/[PROJECT]/datasets/[DATASET]/tables/[TABLE]/insertAll?alt=json returned "Not Implemented: Streaming ingestion is disabled for the destination dataset.">

Actual code used:

class MainHandler(webapp2.RequestHandler):
    def get(self):
        data = json.loads(self.request.get('data'))
        body = {
            'insertId': str(uuid4()),
            'rows':[
                {'json': data}
            ]
        }

        credentials = appengine.AppAssertionCredentials(scope=_SCOPE)
        http = credentials.authorize(httplib2.Http())
        bigquery = discovery.build('bigquery', 'v2', http=http)
        response = bigquery.tabledata().insertAll(
            projectId=PROJECT_ID,
            datasetId=DATASET_ID,
            tableId=TABLE_ID,
            body=body).execute(num_retries=num_retries)

Answer 1

正如Felipe Hoffa所指出的，此功能目前尚未在欧洲数据集上启用。

Answer 2

As the error message suggest: Streaming ingestion is disabled for the destination dataset.

You either try to write to a dataset that is listed as public and read only or it's disabled by BigQuery for some reason, and you can contact them.

You can contact the support here or in case you know it's a known bug, you can try posting an issue here