简体   繁体   English

如何解释Bigquery中的查询过程GB?

[英]How to interpret query process GB in Bigquery?

I am using a free trial of Google bigquery. 我正在使用Google bigquery的免费试用版。 This is the query that I am using. 这是我正在使用的查询。

select * from `test`.events where subject_id = 124 and id = 256064 and time >= '2166-01-15T14:00:00' and time <='2166-01-15T14:15:00' and id_1 in (3655,223762,223761,678,211,220045,8368,8441,225310,8555,8440)

This query is expected to return at most 300 records and not more than that. 预计此查询最多返回300条记录,并且不超过该数量。

However I see a message like this as below 但是我看到这样的消息如下

在此处输入图片说明

But the table on which this query operates is really huge. 但是该查询所依据的表确实很大。 Does this indicate the table size? 这是否表示表格大小? However, I ran this query multiple times a day 但是,我一天多次运行此查询

Due to this, it resulted in error below 因此,导致以下错误

Quota exceeded: Your project exceeded quota for free query bytes scanned. 已超过配额:您的项目超出了已扫描的免费查询字节的配额。 For more information, see https://cloud.google.com/bigquery/troubleshooting-errors 有关更多信息,请参阅https://cloud.google.com/bigquery/troubleshooting-errors

How long do I have to wait for this error to go-away? 我必须等待多长时间才能解决此错误? Is the daily limit 1TB ? 每日限额是1TB吗? If yes, then I didn't not use close to 400 GB . 如果是,那么我没有使用将近400 GB

How to view my daily usage? 如何查看我的日常使用情况?

If I can edit quota , can you let me know which option should I be editing? 如果我可以edit quota ,可以让我知道我应该编辑哪个选项吗?

Can you help me with the above questions? 您能帮我解决上述问题吗?

According to the official documentation "BigQuery charges for queries by using one metric: the number of bytes processed (also referred to as bytes read)", regardless of how large the output size is. 根据官方文档 “ BigQuery使用一种度量标准对查询收费:已处理的字节数(也称为读取的字节数)”,无论输出大小有多大。 What this means is that if you do a count(*) on a 1TB table, you will supposedly be charged $5, even though the final output is very minimal. 这意味着如果在1TB的表上进行count(*)操作,即使最终的输出量很小,也应该向您收取5美元的费用。 Note that due to storage optimizations that BigQuery is doing internally, the bytes processed might not equal to the actual raw table size when you created it. 请注意,由于BigQuery在内部进行的存储优化,因此创建时处理的字节数可能不等于实际的原始表大小。

For the error you're seeing, browse the Google Console to "IAM & admin" then "Quotas", where you can then search for quotas specific to the BigQuery service. 对于您看到的错误,请浏览Google控制台,依次找到“ IAM&admin”和“ Quotas”,然后在其中搜索特定于BigQuery服务的配额。

Hope this helps! 希望这可以帮助! Flavien 黄病毒

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM