Can't create Dataproc Cluster and Transfer job sttoped this night at 1:30

Good morning,

We are in the middle of a customer migration and we use a transfer job to migrate the content and a dataproc cluster to convert the DB.
We did it several times during the last week in test environments, but tonight nothing worked as expected.
We reviewed every step and everything seems okay, we moved to create everything by interface, and when we tried to create the dataproc cluster, the cluster was created with an error but nothing popped up with an error on the logs or another place.

I tried to do the same stems as we did last week in test environments and here is falling too.

About the transfer job, it starts running at 12 more or less and moves 5 million files out of 39 million, but is stuck there since 1.30.

Is there any error on Google service related to Dataproc or something related?

best regards angel

3 Likes

More details.

I tried to create a simple DataProc cluster from other projects by the interface and we got the same results.
So I am thinking about the Google Spark service is out.

Could someone try it in their project to confirm it or discard it?

Best Regards Angel

1 Like