跳到正文
Modal 官方工程博客·· 2024-09-06AI 评分44

Modal 产品更新:应用回滚、动态批处理、Sandbox 隧道与 OpenTelemetry 集成

Product updates: Rollbacks, batching, sandbox tunnels & more

AI 导读

Modal 本月新增应用回滚功能,可在 dashboard 或 CLI 中将应用即时回滚到旧版本;@batched 装饰器支持动态批处理,在延迟与吞吐、GPU 利用率之间做权衡。Sandbox 现可将 TCP 端口转发到公网并 exec 内部进程,同时支持将日志导出到 OpenTelemetry,CPU 核与高端 GPU 价格下调。

正文 · 原文

Welcome to another round of Modal Product Updates! Here’s what’s new this month.

↩️ App rollbacks

Deployed something questionable? You can now instantly roll back your app to a previous version from the dashboard or the CLI.

App rollbacks

Read the docs

📚 Dynamic batching

The @batched decorator accumulates requests into dynamically-sized batches. This lets you trade off latency for throughput and GPU utilization.

Dynamic batching

Read the docs

🏝️ Sandbox tunnels and exec

Sandbox objects can now forward TCP ports to the internet. This is useful if, for example, you want to connect to a web servers running inside them. You can also exec and interface with additional processes inside an existing Sandbox.

We’re interested in improving Sandboxes for agentic use cases. Please reach out to us if you have feedback or feature requests here!

Read the docs

🔭 OpenTelemetry integration

You can now export logs from Modal to your OpenTelemetry provider. If there are more integrations you would like to see, please let us know!

Read the docs

🤑 Pricing changes

CPU cores and higher end GPUs got cheaper! Read the announcement.

Pricing changes

👩‍💻 Client Updates

Run pip install --upgrade modal to get the latest updates. Here are some of the highlights:

For a complete list, check out the changelog.

🥑 Fresh posts

Gradio image generation interface

As always, if you’ve built anything else using Modal, share it with us on the community Slack!

来源:Modal 官方工程博客 · modal.com