We are using Vertex AI’s DeepSeek-V3.1 API service. Recently, we have discovered that when the prompt exceeds a certain length (possibly around 30k tokens), the API ceases to return any valid results, despite the HTTP status code being 200.
1 Like