Agreed Cloud Run with GPU is a big plus which opens doors to run AI/ML workloads on Cloud Run. I am interested in knowing how these GPUs attach to Cloud Run instance. We have a few open models that use Nvidia T4 and currently use a GPU attached GCE VM and contemplating moving to Cloud Run even thoug…

Today we dont support GPU usage based autoscaling, we plan to add that capability in future. As @knet said scaling is CPU based. However if you want to ensure more instances are scaled out, this can be done based on number of incoming requests. If you increase the concurrency of your Cloud Run servi…

Running AI/ML workloads with Cloud Run + GPU (In Preview)

Google Cloud Serverless Applications

dheerajpanyam October 8, 2024, 5:33pm 9

Thanks @ronnelg probably I can use these metrics to scale GPU

Topic		Replies	Views
Is it a good practice to deploy an container hosting an ML model in cloud run Serverless Applications cloud-run	2	153	March 19, 2024
GCP Cloud Run with GPU Compute Infrastructure	1	183	September 26, 2024
Concurrency-only scaling signals issue on Cloud Run Serverless Applications cloud-run	4	115	October 23, 2025

Running AI/ML workloads with Cloud Run + GPU (In Preview)

AI Suggested topics