Generative AI Studio - Tuning Preview Error

Google Cloud Build with AI Custom ML & MLOps
,
1

Hi Team

After some trail and error i am able to successfully reach a point where i can do a sample of Tuning within the Gen. AI Studio with my dataset.
I can see the pipeline tasks are created (15 steps) and each of these steps are executed successfully up until it reaches Step -13 and when i looked into the log i got the below error statement

com.google.cloud.ai.platform.common.errors.AiPlatformException: code=RESOURCE_EXHAUSTED, message=The following quota metrics exceed quota limits: aiplatform.googleapis.com/restricted_image_training_a2_cpus,aiplatform.googleapis.com/restricted_image_training_nvidia_a100_80gb_gpus

In the tuning dialog - there is no way i can select the CPU/GPU type and there is no mention around time reset or time out - but the error says the resource quota has been exhausted ?

any help in how to solve this error ?

2

@SaiMadhvan Facing the same error. Still unable to solve.

3

This happened to me. It looks like in my case the problem was A100 80GB quota (us-central1), this was not solved yet. The documentation says you should check the quota, and also tuning jobs in europe-west4 use 64 cores of the TPU v3 pod custom model training resource, only available upon request.