DataProc Accessing Web Interfaces using Component Gateway results in 502 Error

Google Cloud Data Analytics
1

Accessing Web interfaces such as YARN Resource Manage, Jupyter notebook, of the DataProc cluster results in a 502 error and the page is not getting loaded. This used to happen occasionally but has become more frequent.

The component Gateway is enabled and Internal IP only is disabled. Is there anything that I’m missing?

2

Hi @ajaykmat ,

Welcome to Google Cloud Community!

You’re getting 502 errors because your “Internal IP only” setting for DataProc is disabled while using Component Gateway.

To fix it, re-enable “Internal IP only”. Component Gateway needs this to connect to your cluster’s web interfaces.

Note: Ensure your Component Gateway is correctly configured with routing rules pointing to your DataProc cluster’s internal IP addresses.

I hope this helps.