简体   繁体   English

来自 bigquery 表的 DLP 数据扫描显示起始字节为 null

[英]DLP data scan from bigquery table showing start byte as null

I have scanned a Bigquery table from Google DLP Console.我已经从 Google DLP 控制台扫描了一个 Bigquery 表。 The scan results are saved back into a big query table.扫描结果保存回一个大查询表。 DLP has identified sensitive information, but the start byte is shown as null, can anyone help me understand why? DLP已经识别出敏感信息,但是起始字节显示为null,谁能帮我理解为什么?

在此处输入图像描述

The source data looks as follows:源数据如下所示:

2,james@example.org  ,858-333-0333,333-33-3333,8
3,mallory@example.org,858-222-0222,222-22-2222,8
4,maria@example.org  ,858-444-0444,444-44-4444,1 

------------------------------

If I put the same data in Cloud storage bucket and then perform a scan using DLP, I get the start and end bytes for the sensitive data如果我将相同的数据放入云存储桶中,然后使用 DLP 执行扫描,我将获得敏感数据的开始和结束字节

Thanks folks, the product team is investigating.谢谢大家,产品团队正在调查。 What's happening is that "0" is mapping to null "by accident" due to a proto to BQ schema conversion bug on our end.发生的事情是“0”“意外地”映射到 null,这是由于我们这一端的原型到 BQ 模式转换错误。 We'll address this.我们会解决这个问题。

Unfortunatelly this looks like a bug.不幸的是,这看起来像一个错误。

I was able to reproduce your issue completely;我能够完全重现您的问题; I fallowed these steps:我休假了这些步骤:

  • screated a source csv file:创建了一个源 csv 文件:
1,mail1@test.com,858-333-0333,333-33-3333,8
2,epaweda-8101@yopmail.com,858-333-0334,333-33-3334,3
3,petersko@live.com,858-333-0335,333-33-3335,5
4,danneng@gmail.com,858-333-0336,333-33-3336,1
5,chance@icloud.com,858-333-0337,333-33-3337,4
  • imported it to a BQ table - it looks like this:将其导入到 BQ 表中——它看起来像这样: 在此处输入图像描述

  • DLP'ed it and got the same result with null column: DLP'ed 它并得到与null列相同的结果: 在此处输入图像描述

In my opinion this is a bug (certainly looks like it) so my recommendation would be to go to Google's Issuetracker and report it here (with as much details as possible) and wait for an answer.在我看来,这是一个错误(当然看起来像)所以我的建议是将 go 发送到Google 的 Issuetracker并在此处报告(尽可能详细)并等待答复。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 使用 DLP 从 BigQuery 中去除身份信息 - De-identified data from BigQuery with DLP 使用 Dataflow 的 DLP 从 GCS 读取并写入 BigQuery - 只有 50% 的数据写入 BigQuery - Used Dataflow's DLP to read from GCS and write to BigQuery - Only 50% data written to BigQuery 从工作表到 BigQuery 表的数据连接器未导入 - Data Connectors from Sheets to BigQuery table not importing 数据工作室如何从 Bigquery 制作普通表 - Data studio how to make a normal table from Bigquery 可以在 BigQuery 中以原子方式将数据从一个表移动到另一个表吗? - Possible to atomically move data from one table to another in BigQuery? select 从 BigQuery 中的表中获取几行数据的简单方法? - Simple way to select a few rows of data from table in BigQuery? 有没有办法从 bigquery 获取表详细信息选项卡元数据 - Is there a way to get the table details tab meta data from bigquery 从具有所有列匹配值的 Bigquery 表中删除数据 - delete data from Bigquery table that has all column matching value Bigquery Slot 指标未在 GCP 中显示数据 - Bigquery Slot metrics are not showing data in GCP 如何从日期列中包含 Null 的表在 Google Bigquery 中查询? - How do I query in Google Bigquery from a table that has Null in a date column?
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM