Big Query EXPORT DATA to Cloud Storage - special characters write badly

Google Cloud Data Analytics
1

I need to export data of a BigQuery table into CSV on Google Cloud Storage.

I used the following:

EXPORT DATA
    OPTIONS(
                uri=concat(path_file_output,'_*.csv'),
                format='CSV',
                overwrite=true,
                header=true,
                field_delimiter=';'
            )
AS
 SELECT * FROM my_bigquery_table

In my_bigquery_table there are string columns with the character ‘€’ that are badly changed during the export for example: a field with ‘1234.56 €’ is changed with ‘1234.56 â’.

On the documentation : https://cloud.google.com/bigquery/docs/reference/standard-sql/other-statements there aren’t any other options for the export.

Exist a way to avoid this? Any suggestions?

2

Hi,

For better handling this issue, can you please share the CSV file that we can reproduce?

note: don’t share any PII

3

Hi @abdelilahf , It is a Microsoft issue.

More info here: https://stackoverflow.com/questions/70924793/google-bigquery-export-data-csv-file-on-storage-issue-special-characters-write

1 Like