Building discovery machines that learn, act, and collaborate by discovering how the world works. Research in embodied intelligence, robotics, AI, and machine learning.
14 comments
If a robot AI can figure out how to operate them with very little sim and teleop data, and learn to take advantage of their strengths while maintaining good performance on tasks learned from UMI datasets, teleop data or human headcam videos? Allowing the same "robot mind" to work with different actuators?
Then I would expect those to have a decent niche - sitting between the classic two finger UMI gripper and a humanoid hand. Not a drop-in replacement for a human hand, but still more dexterity per hand without sacrificing all of the ruggedness and mechanical simplicity.
If transfer learning for different actuator types doesn't work so well? I expect the field to collapse to a binary of "UMI gripper or humanoid hand", with nearly no in-between.
In general, I'm carefully optimistic? But we are yet to demonstrate with confidence that this kind of transfer for actuators with radically different kinematics would work.
Motion planning is not the kind of well behaved task where you can change an actuator type and everything just works. And modern robotics specifically, the kind where demands on manipulation capability are the highest, is dealing with open ended environments - where the environment, the task and the objects involves are generally unknown in advance.
Having "strong generalists" like Astra helps bootstrap a lot of things, but that still isn't a "full solve". You don't get to go from "a series of hardcoded commands that use this actuator open a bottle in a sim" to "a set of behavioral heuristics that tell a robot AI how to use this actuator effectively for performing arbitrary operations on unseen objects" for free.
Which is why the dynamics of generalization and transfer learning between actuators are so important. If you need very little data to "bootstrap" a new actuator type, and even a few sim envs can get a robot to perform the tasks it knows from other effector embodiments with it, and start taking advantage of what the new kinematics enable? You're in a very good shape. If transfer barely works, and you need 100000 hours of real world embodied data on diverse tasks per actuator? Living hell.
Also, where are the motors? Inside the gripper, or at the other end of cables?
I'm very impressed with this.
Re: chopsticks, oh but it can! It can roll one chopstick between one pair of grippers. Do that while holding the tip against a fixed object and you'll tilt the chopstick. Once you get the tips touching, it can use them.
The motors are inside those chonky things just outside the fingertips. I'm guessing hobby servos, which are tiny cheap and strong.
This sidesteps the problem: the surface that contacts the object is flat and never bends, so you can apply a huge variety of very detailed grid sensors to it.
The "rolling between the fingers" trick is ultimately what eliminates the need for deformation.
Read the full thread on Hacker News →
Related stories
- Replacing Linear MCP with linear-CLIthebiglog.comHacker News · 1 points · 10 days ago
- Hacker News · 1 points · 8 days ago
- Hacker News · 3 points · 3 days ago
- aljabar - an experimental n-dimensional linear algebra library for Rust based on const genericsgithub.comLobsters · 17 points · over 7 years ago
- Hacker News · 1 points · 10 days ago
- Hacker News · 1 points · 8 days ago