Hey everyone,
I am so excited to share that we just launched a NEW engineering blog to document and openly share our applied research at Vertex AI. Our first post in collaboration with SGLang details how we implemented EAGLE-3 at scale for production workloads andblogt we learned .
Check out the blog. We open-sourced the notebook if you want to reproduce some benchmark results yourself.
Happy learning!