Issue with "Publish Results to BigQuery" Option in Dataplex DataScan via Terraform

Google Cloud Data Analytics
1

Hi team,

I have a question regarding DataScans in Dataplex. I’m deploying a DataScan task using Terraform; however, I’m encountering an issue where the option “Publish results to BigQuery and Dataplex Catalog UI” is not enabled after deployment.

Could you please advise on how to properly configure this option through Terraform?

Thanks in advance!

this is a fragment code in terraform:

jvilchezv_1-1750714242959.png
jvilchezv_1-1750714242959.png1048×282 8.53 KB

jvilchezv_0-1750714134143.png
jvilchezv_0-1750714134143.png570×808 33.9 KB

Joel

2

Hi jvilchezv,

Welcome to Google Cloud Community!

To enable the “Publish results to BigQuery and Dataplex Catalog UI” option after deploying a Dataplex DataScan task using Terraform, you’ll need to ensure a few things are correctly configured both in your Terraform code and in your IAM setup.

With regards to Terraform configuration, in your google_dataplex_datascan resource, make sure you include the data_profile_spec or data_quality_spec block with the result_export configuration. The result_export block is key to publishing results to BigQuery. The Dataplex Catalog UI picks up metadata from these results if the scan is associated with a registered entity in a Dataplex lake and zone.

Also, ensure the Dataplex service account has these permissions:

  • roles/bigquery.dataEditor on the destination dataset
  • roles/dataplex.metadataReader and roles/dataplex.viewer on the lake and zone
  • If scanning external tables (e.g. Cloud Storage), also grant roles/storage.objectViewer on the bucket

If you’ve already deployed the scan and want to enable result publishing post-deployment:

  1. Update your Terraform code to include the result_export block.

  2. Run terraform apply to update the resource.

  3. Confirm that the scan is linked to a Dataplex entity (not just a raw BigQuery table) so the Catalog UI can reflect the results.

If the issue persists, I suggest filing a defect report. This way you could have visibility on the progress of your concern as it is publicly available. Please note that I can’t provide any details or timelines at this moment. For future updates, I suggest keeping an eye out on the issue tracker.

For more details, you may check these links that you may find useful:

Was this helpful? If so, please accept this answer as “Solution”. If you need additional assistance, reply here within 2 business days and I’ll be happy to help.

3

Hi @ruthseki

Thanks for your answer,
This is my code that include the data_profile_spec

jvilchezv_0-1750963839244.png
jvilchezv_0-1750963839244.png663×751 23.9 KB

Horever, I can’tpublish results to BigQuery and Dataplex Catalog UI

Joel.