在 BigQuery 中读取时，未定义行 XXXX、列 xx-xx 处的 JSON 输入意外结束

Question

I have a table in Bigquery which has 2 columns - job_id and json_column (string which is in JSON format). When I tried to read the data and identify some objects it gives me error as below:

SyntaxError:Unexpected end of JSON input at undefined line XXXX, columns xx-xx

It Always gives me line 5931 and second time I execute again it gives line 6215.

If it's related to JSON structure issue, how can I know which row/ job_id that number 5931 corresponds to? If I subset for a specific job_id , it returns the values but when I tried to execute on the complete table, I got this error. I tried looking at the job_id at the row_numbers mentioned and code works fine for those job_id s.

Do you think its JSON structure issue and how to identify which row/ job_id has this Issue?

Table Structure:

Code:

CREATE TEMPORARY FUNCTION CUSTOM_JSON_EXTRACT(json STRING, json_path STRING)
    RETURNS ARRAY<STRING>
    LANGUAGE js AS """
      var result = jsonPath(JSON.parse(json), json_path);
      if(result){return result;} 
      else {return [];}
    """
    OPTIONS (
        library="gs://json_temp/jsonpath-0.8.0.js"
    );

SELECT job_id,dist,gm,sub_gm
FROM lz_fdp_op.fdp_json_file,
UNNEST(CUSTOM_JSON_EXTRACT(trim(conv_column), '$.Project.OpsLocationInfo.iDistrictId')) dist ,
UNNEST(CUSTOM_JSON_EXTRACT(trim(conv_column), '$.Project.GeoMarketInfo.Geo')) gm,
UNNEST(CUSTOM_JSON_EXTRACT(trim(conv_column), '$.Project.GeoMarketInfo.SubGeo')) sub_gm 

Answer 1

Would this work for you?

WITH 

T AS (
  SELECT
    '1000149.04.14' AS job_id,
    '{"Project":{"OpsLocationInfo":{"iDistrictId":"A"},"GeoMarketInfo":{"Geo":"B","SubGeo":"C"}}}' AS conv_column
)

SELECT
  JSON_EXTRACT_SCALAR(conv_column, '$.Project.OpsLocationInfo.iDistrictId') AS dist,
  JSON_EXTRACT_SCALAR(conv_column, '$.Project.GeoMarketInfo.Geo') AS gm,
  JSON_EXTRACT_SCALAR(conv_column, '$.Project.GeoMarketInfo.SubGeo') AS sub_gm
FROM
  T

BigQuery JSON Functions docs: https://cloud.google.com/bigquery/docs/reference/standard-sql/json_functions

how can I read multiple arrays in an object in JSON without using unnest?

Can you explain better with an input sample your comment?