Will it work with Langchain? Other embeddings? (Vertex AI doesn’t seem to work with any other embeddings)
Have you tried exploring the workbench section where you can create jupyterlab instances?
Maybe you can use langchain inside the notebook and then use the vertex ai api when your embeddings are ready.
Hi @midnightjourney ,
Welcome and we appreciate you reaching out to our community.
I get that you are having concerns with Vertex AI embeddings. A quick answer to your question is yes, there are recent developments that allows support for custom/ other embeddings with Vertex AI.
For one, you can read through this published Google Cloud Blog (Building Generative AI applications made easy with Vertex AI PaLM API and LangChain), dated August 12, 2023. It has detailed information on how you will go about with Vertex AI PaLM API and LangChain.
There are other possible workarounds but it will require you to create your own embeddings then use it in Vertex AI.
Here are some useful links:
- langchain.embeddings.vertexai.VertexAIEmbeddings
- LLMs | Google Vertex AI PaLM
- Chat Model | Google Cloud Platform Vertex AI PaLM
- Overview of Generative AI support on Vertex AI
- Introduction to Vertex AI Feature Store
Hope this helps.