BigQuery external table limitations

Hi @ms4446 , I was wondering if there is a completely different approach that can be explored.

To summarize my use case, we are storing product data. There are close to 3 billion products, they are stored as JSON. Products are constantly being updated.

We have identified important attributes, extracted them from JSON and stored them in columns in the native BigQuery table.

I am looking for a cost-effective approach for storing the complete JSONs and accessing them if required.

I also tried storing the JSON in native BigQuery. But facing problems because of the frequent updates to the data.