Pipeline provisioning status takes too long

Google Cloud Data Analytics
1

Hi,

I’m using CDF with ephemeral cluster on dataproc. The machine has this typology:

**Master Machine Type:**e2, **Number of masters:**1,**Master Cores:**2,**Master Memory (GB):**8,**Master Disk Size (GB):**1000,**Worker Cores:**2,**Worker Memory (GB):**8,**Worker Disk Size (GB):**200,**Worker Machine Type:**e2

Even with a simple pipeline it takes ate least 3-5 minutes to provisioning…
Could be the master core and memory?

Thank you

2

I solved this issue by creating a new compute profile, upgrading the machine type from E2 to N2, and increasing the master memory to 16GB .

1 Like