I am testing the Vertex API and this really strange case appeared.
When using AnthropicVertex, and calling for a streamed response, the last message the model gives is message_stop, as per Anthropic’s documentation. I use this event to do some cleaning at the end of the stream.
Local logs:
But when deploying to cloud run and using the same api, the message_stop is not sent. Any ideas why? I am using the same endpoint, same config.
Prod logs:
