跳到正文
Rohan Paul· @rohanpaul_ai · X·· 2026-07-10AI 评分52
AI 导读

Perceptron Egocentric 旨在解决机器人训练数据瓶颈——录制演示容易,但手动标注每个抓取、握持、移动等耗时昂贵。输入原始机器人摄像头或第一人称视频,输出结构化标签:时间戳、子任务边界、每手动作、逐帧手部位置及左右手识别。系统在基于 Gemini 3.5 Flash 和 Gemini Robotics-ER 1.6 的标注流程上达到 SOTA 水平。早期访问现已向合作伙伴开放。

正文 · 原文

This looks like another step toward removing the data bottleneck in robotics.

The bottleneck exists because recording demonstrations is easy, but labeling every grasp, hold, move, and release is slow and expensive.

Perceptron Egocentric dropped a new robotics video annotation system.

You give it raw robot-camera or first-person/egocentric video.

It gives back structured labels that look more like training data: where each small manipulation starts and ends, what the subtask is, what each hand is doing, where the hands are frame by frame, and which hand is left or right.

So,

Input: raw video of a person or robot doing a task.
Output: a machine-readable breakdown of the physical actions inside that video.

Basically, it is a machine that converts robot video into policy-training supervision.

That means timestamps, subtask boundaries, per-hand actions, and left-right hand grounding.

So this will turn large piles of robot or egocentric video into supervision for training robot policies.

引用Perceptron AI@perceptroninc
We’re launching the first in a series of Embodied Reasoning offerings: Perceptron Egocentric. It achieves SOTA over the best robotic annotation pipelines built on Gemini 3.5 Flash and Gemini Robotics-ER 1.6. Early access is available to partners.
在 X 查看被引用的帖子

来源:Rohan Paul · x.com