As of now GCP LLMs (text-bison, chat-bison etc.) are located in US Central, as per - https://cloud.google.com/vertex-ai/docs/generative-ai/model-reference/overview#available_regions.
If a client is located in India, and they want to use text-bison for developing a Question-Answer system, and they DO NOT want any enterprise data (customers, products etc.) to be passed on to outside of India, due to privacy & other reasons, how can they develop such a system?
I understand that, no training of LLM will happen using client’s data, without client’s consent, but some data (in the form of user queries, e.g. about a product) will have to be passed to US based LLM, to get response right? How will that be handled?