Hi everyone,
I just want to share that we’ve published a write-up on elastic training on TPUs in collaboration with Abhinav (MaxText) and Luke (Pathways). In this post, we discuss about why elastic training, what it is, and how it works with MaxText, Pathways, and Orbax on TPUs, including a simple example.
If you’d like to learn more, check it out
here ![]()
If you have any questions or you would like to see content on any particular topic, please feel free to reach out.