GCP Cloud Run with GPU

Google Cloud Compute Infrastructure
1

Hello,
I’m trying to deploy Docker Image with Artifact Registry using Cloud Run.
It worked fine when I deployed it without process using GPUs.
I wanted to deploy an AI model with it, so I requested a GPU for Cloud Run, and I got an email that I could use NVIDIA L4.
So, I edited my docker image so that it could use AI with GPU, but my service was terminated with error no. 9

I was confused but I found that the docker image cannot find any GPU inside the Cloud Run environment.
Is there any way that I can use GPU inside Cloud Run?

1 Like
2

Hi @woobin100 ,

Welcome to Google Cloud Community!

Based on the release notes of Cloud Run, yes, you can now use GPU in your Cloud Run service. May I know what specific error you are getting? Meanwhile, you can refer to this GPU configuration on Cloud Run documentation for the guide and pricing.

Also, since you are working with AI, this Google blog regarding AI on Cloud Run with GPU might be worth a read if you’re looking for new insights.

I hope the above information is helpful.