Small Language model on IOT device integration with Vertex AI

Google Cloud Build with AI Custom ML & MLOps
1

Hi All,

I wanted to check if Small language models ( SLM’s) like Tinybert can be integrated with Vertex AI?

Also request you to recommend small language models for conversational AI like the ones that will run on TV remote " to converse with you, find and recommend movies" or similar IOT edge devices.

Thanks

2

Hi @ShivaKarra ,

Welcome and thank you for reaching out to our community.

Both of your inquiries will most likely fall under the “Train and use your own models” article since the mainstream language models of Vertex AI are considered as large language models (LLM).

Consider reviewing these available models and choose what will fit your needs. You also have the option to build your own language model then train them accordingly.

Hope this helps.