I am using data fusion to extract data which is loaded into BigQuery. From the source table, the datefield is stored as “TIMESTAMP_NTZ(9)” and currently its loading as a UTC format in BigQuery. I am trying to figure out, which syntax can be used in wrangler which converts the fields to PST.
Sample of date stored in BigQuery: “2020-10-30T10:15:12Z[UTC]”
At the moment, I have tried a few variety of set-column, parse-as-simple-date, timestamp-to-datetime but not successful at the moment.
I would appreciate any guidance if this conversion is possible.
You need to specify your time zone when loading your data to BigQuery. If there is no time zone specified, it will use the default time zone which is UTC. Check again your directives and validate if you specify your time zone.
If the issue persists, you can apply the transformation in BigQuery using the SQL provided by @Rhountu .
SELECT
Timestamp_NTZ AS original_timestamp,
TIMESTAMP(DATETIME(Timestamp_NTZ, 'America/Los_Angeles')) AS pst
FROM `project_name.dataset_name.table_name`
Was this helpful? If so, please accept this answer as “Solution”. If you need additional assistance, reply here within 2 business days and I’ll be happy to help.