NEW: Deploying Vertex AI Model Garden Open Models with Terraform

Vertex AI announced Infrastructure-as-Code (IaC) for open model deployments on Vertex AI Model Garden.

You can now leverage the google_vertex_ai_endpoint_with_model_garden_deployment Terraform resource to automate the entire deployment process.

Key takeways:

  • Manage the complete Vertex AI deployment lifecycle using a unique main.tf file.
  • Declaratively configure dedicated resources, handle multiple model deployments, and set up PSC endpoints.
  • Support for deploying models directly from the Vertex AI Model Garden catalog or the Hugging Face hub.

Please refer to the official documentation and the example notebook for implementation details (links available in the original post).

:pushpin: Notebook

:pushpin: Vertex AI Model Garden doc

:pushpin: Terraform doc

Happy building!

1 Like