InFeeo
Language

A bimanual robot keeping up with a live air-hockey puck at 1x speed: a video-action policy that predicts the next frames, then acts in a closed loop(reddit.com)

×
Link preview A bimanual robot keeping up with a live air-hockey puck at 1x speed: a video-action policy that predicts the next frames, then acts in a closed loop Real robot, two arms, 1x speed. The task is deliberately reactive: the puck keeps moving, so a policy that only maps the current camera frame to a motor command tends to lag a fraction of a second and lose it. The approach on screen is a predict-then-correct loop. Rather than going straight from camera to action, the policy predicts how the scene will move over the next moments, acts inside that predicted future, then re-grounds on each real frame that arrives so it does not drift. That is what keeps it in sync with a fast target. The model behind it is LingBot-VA 2.0, a video-action policy. Genuinely curious what people here make of the world-model-first framing (predict the near-future scene, then act on it) versus a plain reactive VLA with enough data. Source and the honest limits in a comment. submitted by /u/Even-Implement-1442 [link] [Kommentare] reddit.com · reddit.com
Real robot, two arms, 1x speed. The task is deliberately reactive: the puck keeps moving, so a policy that only maps the current camera frame to a motor command tends to lag a fraction of a second and lose it. The approach on screen is a predict-then-correct loop. Rather than going straight from camera to action, the policy predicts how the scene will move over the next moments, acts inside that predicted future, then re-grounds on each real frame that arrives so it does not drift. That is what keeps it in sync with a fast target. The model behind it is LingBot-VA 2.0, a video-action policy. Genuinely curious what people here make of the world-model-first framing (predict the near-future scene, then act on it) versus a plain reactive VLA with enough data. Source and the honest limits in a comment. submitted by /u/Even-Implement-1442 [link] [Kommentare]

Comments

Log in Log in to comment.

No comments yet.