Error trying to execute Dataform with Workflow

Google Cloud Data Analytics
1

Hi all.

I followed instructions in this article Schedule executions with Workflows and Cloud Scheduler | Dataform | Google Cloud

But my scheduler still returning a 403 non authorized, even when I add the roles to the service user.

Can anyone helpme this?

Appreciate all the help.

2

Hi @robertoctorresf ,

If I understand the issue, the most likely reason why you are getting a 403 non authorized error is because the service user does not have the correct permissions to run the Cloud Scheduler job.

To fix this, you need to make sure that the service user has the following permissions:

  • Cloud Scheduler: Create and manage jobs
  • Cloud Scheduler: List jobs
  • Cloud Scheduler: Get job details
  • Cloud Scheduler: Execute job

Once you have granted the service user these permissions, the Cloud Scheduler job should be able to run successfully.

If you are still having trouble, you can contact Google Cloud Platform support for assistance.

3

Hi. I already added the roles the service user, im receiving the following error:

HTTP server responded with error code 403
in step “createCompilationResult”, routine “main”, line: 13
{
“body”: {
“error”: {
“code”: 403,
“message”: “Location uscentral-1 is not found or access is unauthorized.”,
“status”: “PERMISSION_DENIED”

The dataform repo im trying to execute is this one
NameLocationSourceGit token secret status

vortix-etl us-central1

Is this url the right one to access the repository ?

https://dataform.googleapis.com/v1beta1/

projects/carga-segura-375123/locations/uscentral-1/repositories/vortix-etl/compilationresults

4

Hey @robertoctorresf

It seems that you are facing the same issue I had last week.

Adding specific roles to the workflow service account solved a problem for me.
The needed roles are

  • dataform.compilationResults.create
  • dataform.workflowInvocations.create.

Or simply Dataform Service Agent.

docs for compilationResults and workflowInvocations endpoints
it would be nice to mention these role requirements in dataform docs.

Hope this helps.