Hi,
There are multiple ways of loading data from Bigquery to CloudSQL.
Dataflow/CLI import/FDW (not available in CloudSQL though)/PaaS
We are trying to identity the optimal way to load data.
Dataflow - establishes JDBC connection and loads record by record. Not as quick as batch load (eg: SQL import CLI)
CLI import - its effective, but only 1 import at a time per instance.
We essentially looking for best of both worlds. Need the performance of CLI import with parallelism.
Do you have any suggestion on how to