[Bug]: Gemini API via Vertex AI sometimes repeats the ending words in stream responses.

Google Cloud Build with AI Custom ML & MLOps
1

Problem you have encountered:

Gemini Vertex AI API sometimes repeats the ending phrase or words in response. This includes the repetition of last words or last sentences.

What you expected to happen:

API response without repetition of ending words or phrases

Steps to reproduce:

Call this curl command in Postman multiple times and you will notice the ending sentence repeated twice. https://drive.google.com/file/d/14zu0oXH3vUfVUuhmp-2BiwvzUDTbC75g/view?usp=sharing

2 Likes
2

Hi there!

I’m facing the same issue with repeating words at the end of response. Even if you test Gemini in vertex AI Studio you can get the same behaviour.

1 Like
3

Hello, I’ve been having the same issue for over a week now. I’ve tested different types of prompting and parameters, but the ending phrase is still repeating.

4

Just an update that this issue has been resolved already. More details here.