I have a large json file that I like to flatten and import as a table into big-query.
I tried uploading it to gcp cloud storage and importing to bigquery, but get
Failed to create table: Error while reading data, error message: Failed to parse JSON: Unexpected end of string; Unexpected end of string; Expected key
Does anyone has an example script, for example in python, that reads and parses out such a json file line-by-line and writes into a table. Unfortunately the file as its too large to fit into memory to be able to directly use something like pandas libraries.
[ that assumes newline delimited json ], I can’t tell if your usecase includes that….
Yeah, does not look like the json is delimited unfortunately
