Modal 产品更新:应用回滚、动态批处理、Sandbox 隧道与 OpenTelemetry 集成
Product updates: Rollbacks, batching, sandbox tunnels & more
Modal 本月新增应用回滚功能,可在 dashboard 或 CLI 中将应用即时回滚到旧版本;@batched 装饰器支持动态批处理,在延迟与吞吐、GPU 利用率之间做权衡。Sandbox 现可将 TCP 端口转发到公网并 exec 内部进程,同时支持将日志导出到 OpenTelemetry,CPU 核与高端 GPU 价格下调。
Welcome to another round of Modal Product Updates! Here’s what’s new this month.
↩️ App rollbacks
Deployed something questionable? You can now instantly roll back your app to a previous version from the dashboard or the CLI.
📚 Dynamic batching
The @batched decorator accumulates requests into dynamically-sized batches. This lets you trade off latency for throughput and GPU utilization.
🏝️ Sandbox tunnels and exec
Sandbox objects can now forward TCP ports to the internet. This is useful if, for example, you want to connect to a web servers running inside them. You can also exec and interface with additional processes inside an existing Sandbox.
We’re interested in improving Sandboxes for agentic use cases. Please reach out to us if you have feedback or feature requests here!
🔭 OpenTelemetry integration
You can now export logs from Modal to your OpenTelemetry provider. If there are more integrations you would like to see, please let us know!
🤑 Pricing changes
CPU cores and higher end GPUs got cheaper! Read the announcement.
👩💻 Client Updates
Run pip install --upgrade modal to get the latest updates. Here are some of the highlights:
- Web endpoints can now be parametrized.
- Methods in a
clsnow share the same pool of containers. - App deployments are now atomically applied.
For a complete list, check out the changelog.
🥑 Fresh posts
- Modal supports HIPAA compliance
- Inside the Modal Code Playground
- Beat GPT-4o at Python by searching with 100 dumb LLaMAs
- Publish custom metrics with Prometheus Pushgateway
- Custom Pet Art from Flux with Hugging Face and Gradio
As always, if you’ve built anything else using Modal, share it with us on the community Slack!
来源:Modal 官方工程博客 · modal.com