喜欢这段预告片哈哈（而且是真的） 学术界把我们限制得太紧了，差点崩溃，但我们挣扎着爬了出来，在另一边发现了一个全新的宇宙😅 感谢 Google 支持我们这些缺 GPU 的叛逆者，带我们踏上这段旅程，帮助我们建立了我认为是 Google 之外最好的 TPU/GCP 基础设施团队之一 [引用 @TongPetersb]：我们已经在学术界用 TPU 训练两年了（非常感谢 Google TRC！）。像 Cambrian-1、Cambrian-S、RAE 和 Scale-RAE 这样的工作没有 TPU 是不可能的。 我们写了一篇博客文章分享我们的经验、优化和教训：https://cambrian-mllm.github.io/blog/tpu-training-experiments.html 我们希望这能帮助更多人更顺畅地使用 TPU，它们非常强大！
love this teaser lol (and it is real)
academia boxed us in sooo tightly that we nearly broke, but we clawed our way out and found a whole new universe on the other side😅
thank you to Google for supporting the gpu-poor rebels and pulling us into this ride, helping us build what I believe is one of the best tpu/gcp infrastructure teams outside of google
We have been training with TPUs in academia for two years now (huge thanks to Google TRC!). Works like Cambrian-1, Cambrian-S, RAE, and Scale-RAE would not have been possible without TPUs. We wrote a blog post sharing our experiences, optimizations, and lessons learned: https://cambrian-mllm.github.io/blog/tpu-training-experiments.html We hope this can help more people having a smoother experience working with TPUs, they are very powerful!在 X 查看被引用的帖子
来源：Saining Xie · x.com