Current Token: 1,576,564 tokens
I use this file for testing, is the 2M context window in vertex-ai is fake?
1 Like
I tried 254k tokens (used the model to count the tokens) and it also doesn’t respond properly. When the prompt’s token count is reduced, the model starts responding.
It looks like the model description in that UI is not exactly accurate. Until the future wide release, to get access to 1.5 Pro with a 2 million token context window join the Trusted Testers program in Vertex AI. The current public model info is documented here.
2 Likes
Thank you for your support !
I have just submitted it. When can I expect a response? 
3 Likes
Hey @mongoose , You may be hitting other individual validation limits on images/audio/video per the documented limits. So rather than the total token count throwing the error, its an individual token limit on a media type that is throwing the error. I agree that the error messages can be more useful, and I think that is coming in the future.
1 Like
Still not working.
3 Likes