智谱（Zai）分享 GLM-5.3 帮助构建并优化 GLM-5.3-Flash 推理基础设施的过程，系统从首次成功运行到生产就绪用时不到两周，端到端吞吐相对初始基线提升至 3 倍。
A brilliant post from the GLM-5.3 team on RSI (recursive self-improvement).
GLM-5.3 was already used to optimize the infrastructure that runs GLM itself, including production kernel and concurrency fixes. It helped triple GLM-5.3-Flash throughput on 100,000+ accelerators.
Their early self-improvement loop: the model improves its serving system, that system runs the model, and the engineering knowledge accumulates for the next optimization cycle.
Engineers still set objectives and boundaries, while the agent handled analysis, hypotheses, code changes, and experiments.
In one test, Prefill plus KV Transfer lagged Prefill alone by over 20%, and the agent traced the slowdown to the Python GIL, and releasing that lock cut the gap below 1%
Another kernel change reached a 1.71x speedup over the prior version by eliminating repeated FP32 normalization and gating work.
We’re sharing how GLM-5.3 helped build and optimize the inference infrastructure serving GLM-5.3-Flash. The system went from its first successful run to production readiness in less than two weeks, with end-to-end throughput tripling relative to the initial baseline. The key was dense feedback: local correctness tests, execution traces, microbenchmarks, and end-to-end measurements that enabled targeted hypothesis testing rather than reliance on aggregate performance metrics alone. https://z.ai/blog/glm-built-its-inference-infrastructure在 X 查看被引用的帖子
来源：Rohan Paul · x.com