简体   繁体   English

是否可以按摄取时间对按摄取时间分区的 BQ 表进行聚类?

[英]Is it possible to cluster by Ingestion Time a BQ table partitioned by Ingestion Time?

We currently use a BQ table partitioned by day on a column date1 and clustered by the same date column date1 .我们目前使用 BQ 表,该表在列date1 date1 This enables us to optimize our costs.这使我们能够优化成本。 However, we would like to use the tables partitioned by ingestion time instead but I haven't found if it was possible to also cluster by _PARTITIONTIME.但是,我们想改用按摄取时间分区的表,但我还没有发现是否也可以按 _PARTITIONTIME 进行聚类。

Does anyone know if we can do such thing in BigQuery?有谁知道我们是否可以在 BigQuery 中做这样的事情?

Thanks for your help谢谢你的帮助

From a recent release, BigQuery clustering is independent of the partitioning .最近的版本开始,BigQuery 集群独立于分区 Therefore, there is no limitation with (or without) ingestion time partitioning.因此,没有(或没有)摄取时间分区的限制。 I did a test and it worked great我做了一个测试,效果很好

在此处输入图像描述

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 如何从 AWS Oracle RDS 到 Dyanmo DB 进行实时数据摄取 - How to do Real time Data Ingestion from AWS Oracle RDS to Dyanmo DB PubSub 发布者摄取 - PubSub Publisher Ingestion Python 数据摄取(从对 AWS S3 存储桶的 API 调用“获取”开始),如何管理用户名/密码/API 密钥和令牌(在短时间窗口内过期) - Python Data Ingestion (Start with API call "Get" to AWS S3 Bucket), how to manage the username/pwd/api-key and token( expired in short time window) 如何使用 kql 查询查找哪个 pod 在 AKS 集群中摄取更多数据? - How to find which pod is taking more data ingestion in AKS cluster using kql query? 使用数据融合将 pubsub 消息摄取到 Bigquery - pubsub message ingestion into Bigquery using data fusion 来自 s3 的德鲁伊三角洲摄取 - Delta Ingestion in druid from s3 将新摄取文件的审计报告自动化到 s3 - automation of audit report of new ingestion files into s3 如何通过指定分区将分区插入到 Python 中的 BigQuery 提取时间分区表中 - How to Insert a partition into BigQuery's fetch time partitioned table in Python by specifying a partition 集群模式下的 Redis `TIME` 命令 - Redis `TIME` Command in Cluster Mode 是否可以使用 StackDriver 随时间监控 Kubernetes 集群中的 Pod 副本数量? - Is it possible to monitor the number of pod-replicas in a Kubernetes cluster over time with StackDriver?
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM