Category Archives: Human Robots

Everything about Humanoid Robots and Androids

#439698 Artificial fiber spun from liquid ...

A team of researchers at the University of California has developed a way to create an artificial fiber that performs very much like human muscle fibers. In their paper published in the journal Science Robotics, the researchers describe their process and how well the fiber worked when tested. Continue reading

Posted in Human Robots

#439693 Agility Robotics’ Digit is Getting ...

Agility Robotics' Digit humanoid has been taking a bit of a break from work during the pandemic. Most of what we've seen from Agility and Digit over the past year and a half has been decidedly research-y. Don't get me wrong, Digit's been busy making humans look bad and not falling over when it really should have done, but remember that Agility's goal is to make Digit into a useful, practical robot. It's not a research platform—as Agility puts it, Digit is intended to “accelerate business productivity and people's pursuit of a more fulfilling life.” As far as I can make out, this is a fancier way of saying that Digit should really be spending its time doing dull repetitive tasks so that humans don't have to, and in a new video posted today, the robot shows how it can help out with boring warehouse tote shuffling.

The highlights here for me are really in the combination of legged mobility and object manipulation. Right at the beginning of the video, you see Digit squatting all the way down, grasping a tote bin, shuffling backwards to get the bin out from under the counter, and then standing again. There's an unfortunate cut there, but the sequence is shown again at 0:44, and you can see how Digit pulls the tote towards itself and then regrasps it before lifting. Clever. And at 1:20, the robot gives a tote that it just placed on a shelf a little nudge with one arm to make sure it's in the right spot.

These are all very small things, but I think of them as highlights because all of the big things seem to be more or less solved in this scenario. Digit has no problem lifting things, walking around, and not mowing over the occasional human, and once that stuff is all sorted, whether the robot is able to effectively work in an environment like this is to some extent reflected in all of these other little human-obvious things that often make the difference between success and failure.
The clear question, though, is why Digit (or, more broadly, any bipedal robot) is the right robot to be doing this kind of job. There are other robots out there already doing tasks like these in warehouses, and they generally have wheeled bases and manipulation systems specifically designed to move totes and do nothing else. If you were to use one of those robots instead of Digit, my guess is that you'd pay less for it, it would be somewhat safer, and it would likely do the job more efficiently. Fundamentally, Digit can't out box-move a box-moving robot. But the critical thing to consider here is that as soon as you run out of boxes to move, Digit can do all kinds of other things thanks to its versatile humanoid design, while your box-moving robot can only sit in the corner and be sad until more boxes show up.
“We did not set out to build a humanoid robot. We set out to solve mobility.”
—Agility CTO Jonathan Hurst
“Digit is very, very flexible automation,” Agility CTO Jonathan Hurst told us when we asked him about this. “The value of what we're doing is in generality, and having a robot that's going be able to work carrying totes for three or four hours, then go unload boxes from trailers for three or four hours, keep up with you if you change your workflow entirely. Many of these spaces are designed specifically around the human form factor, and it's possible for a robot like Digit to do all of these different boring, repetitive jobs. And then when things get complicated, humans are still doing it.”
The value of having a human-like robot in a human environment comes into play as soon as you start thinking about typical warehouse situations that would be trivial for a human to solve but that are impossible for wheeled robots. For example, Hurst says that Digit is capable of using a stool to reach objects on high shelves. You could, of course, design a wheeled robot with an extension system to allow it to reach high shelves, but you're now adding more cost and complexity, and the whole point of a generalist humanoid robot is that in human environments, you just don't have to worry about environmental challenges. Or that's the idea, anyway, but as Hurst explains, the fact that Digit ended up with a mostly humanoid form factor was more like a side effect of designing with specific capabilities in mind:
We did not set out to build a humanoid robot. We set out to solve mobility, and we've been on a methodical path towards understanding physical interaction in the world. Agility started with our robot Cassie, and one of the big problems with Cassie was that we didn't have enough inertia in the robot's body to counteract the leg swinging forward, which is why Digit has an upright torso. We wanted to give ourselves more control authority in the yaw direction with Cassie, so we experimented with putting a tail on the robot, and it turns out that the best tail is a pair of bilaterally symmetrical tails, one on either side.
Our goal was to design a machine that can go where people go while manipulating things in the world, and we ended up with this kind of form factor. It's a very different path for us to have gotten here than the vast majority of humanoid robots, and there's an awful lot of subtlety that is in our machine that is absent in most other machines.IEEE Spectrum: So are you saying that Digit's arms sort of started out as tails to help Cassie with yaw control?
Jonathan Hurst: There are many examples like this—we've been going down this path where we find a solution to a problem like yaw control, and it happens to look like it does with animals, but it's also a solution that's optimal in several different ways, like physical interaction and being able to catch the robot when it falls. It's not like it's a compromise between one thing and another thing, it's straight up the right solution for these three different performance design goals.
Looking back, we started by asking, should we put a reaction wheel or a gyro on Cassie for yaw control? Well, that's just wasted mass. We could use a tail, and there are a lot of nice robots with tails, but usually they're for controlling pitch. It's the same with animals; if you look at lizards, they use their tails for mid-air reorienting to land on their feet after they jump. Cassie doesn't need a tail for that, but we only have a couple of small feet on the ground to work with. And if you look at other bipedal animals, every one of them has some other way of getting that yaw authority. If you watch an ostrich run, when it turns, it sticks its wing out to get the control that it needs.
And so all of these things just fall into place, and a bilaterally symmetrical pair of tails is the best way to control yaw in a biped. When you see Digit walking and its arms are swinging, that's not something that we added to make the motion look right. It looks right because it literally is right—it's the physics of mobility. And that's a good sign for us that we're on the right path to getting the performance that we want.
“We're going for general purpose, but starting with some of the easiest use cases.”
—Agility CTO Jonathan Hurst
Spectrum: We've seen Digit demonstrating very impressive mobility skills. Why are we seeing a demo in a semi-constrained warehouse environment instead of somewhere that would more directly leverage Digit's unique advantages?
Jonathan Hurst: It's about finding the earliest, most appropriate, and most valuable use cases. There's a lot to this robot, and we're not going to be just a tote packing robot. We're not building a specialized robot for this one application, but we have a couple of pretty big logistics partners who are interested in the flexibility and the manipulation capabilities of this machine. And yeah, what you're seeing now is the robot on a flattish floor, but it's also not going to be tripped up by a curb, or a step, or, a wire cover, or other things on the ground. You don't have to worry about anything like that. So next, it's an easy transition next to unloading trailers, where it's going to have to be stepping over gaps and up and down things and around boxes on the floor and stuff like that. We're going for general purpose, but starting with some of the easiest use cases.
Damion Shelton, CEO: We're trying to prune down the industry space, to get to something where there's a clear value proposition with a partner and deploying there. We can respect the difficulty of the general purpose use case and work to deploy early and profitably, as opposed to continuing to push for the outdoor applications. The blessing and the curse of the Ford opportunity is that it's super interesting, but also super hard. And so it's very motivating, and it's clear to us that that's where one of the ultimate opportunities is, but it's also far enough away from a deployment timeline that it just doesn't map on to a viable business model.
This is a point that every robotics company runs into sooner or later, where aspirations have to succumb to the reality of selling robots in a long-term sustainable way. It's definitely not a bad thing, it just means that we may have to adjust our expectations accordingly. No matter what kind of flashy cutting-edge capabilities your robot has, if it can't cost effectively do dull or dirty or dangerous stuff, nobody's going to pay you money for it. And cost effective usefulness is, arguably, one of the biggest challenges in bipedal robotics right now. In the past, I've been impressed by Digit's weightlifting skills, or its ability to climb steep and muddy hills. I'll be just as impressed when it starts making money for Agility by doing boring repetitive tasks in warehouses, because that means that Agility will be able to keep working towards those more complex, more exciting things. “It's not general manipulation, and we're not solving the grand challenges of robotics,” says Hurst. “Yet. But we're on our way.” Continue reading

Posted in Human Robots

#439691 Researchers develop bionic arm that ...

Cleveland Clinic researchers have engineered a first-of-its-kind bionic arm for patients with upper-limb amputations that allows wearers to think, behave and function like a person without an amputation, according to new findings published in Science Robotics. Continue reading

Posted in Human Robots

#439686 We’re Getting Closer to Flying ...

A couple of years ago, we wrote about a bipedal robot called Jet-HR1 under development at the Guangdong University of Technology. With little foot-mounted ducted fans, Jet-HR1 could step across very wide gaps by using the thrust created by the fans to futz with its center of gravity. That's cool and all, but let's take the logical (or not!) next step and see what happens when those ducted fans get cranked up as high as they'll go: flying humanoid robot! Sort of!

This is obviously just the first tentative little airborne hop, but by the end of the video, you can see that the stabilization works pretty well. I wouldn't call it completely controllable yet, but it's tangible progress.

Jet-HR2 has 10 degrees of freedom for ground locomotion, plus four ducted fans, two statically mounted on the robot's waist and two mounted inside the feet that can be actuated through ankle movements. Each fan can deliver 5 kg of thrust, for 20 kg total, enough to lift the 17 kg robot. The thrust to weight ratio here is not great, which is where the control challenge is; without a lot of spare oomph, you have to be very careful about how you allocate thrust. But the system that you see in the video is able to effectively suppress diving and spinning, leading to a stable (although not entirely under control) flying most-of-a-humanoid robot.
A word here on practical applications—there aren't a heck of a lot of good reasons to make a humanoid robot in the first place. So why, then, is a flying humanoid robot actually useful? Or does it get a pass because, I mean, c'mon, a flying humanoid robot, right? Here's what the paper says:
Recently, various disaster-response humanoid robots have been invented with unique control theories and other mechanisms to overcome uneven terrain. Traditionally, humanoid robots have overcome these obstacles by stepping and climbing yet these strategies lack efficiency, especially for dangerous environments like insurmountable obstacles and geological faults. For urgent tasks in complex real scenarios, humanoid robots are expected to have dynamic aerial skills, such as high or long jumps, short distance flights, and hovering that exceed the body length several times.
The performance of humanoid robots is still not up to the human level, especially with an increase in mass. On the other hand, even at the human level, robots may appear helpless on loose, collapse prone, or cliff-like terrain. This seems to be a limitation of using purely joint actuators to generate force. In this study, a novel humanoid robot that can fly using a ducted fan propulsion system was developed to explore its potential value for search and rescue in complex environments.Frequent readers of this site may have seen this one coming: robots for disaster relief and search and rescue tend to be the catch-all justifications for weird mobility concepts without immediately obvious applications. But on the other hand, this is actually one of the reasons why making a humanoid might be a good idea, because having robots that can go where humans go can be very helpful. That is, if you can get them to work, which you probably can't, because practical humanoid robots are super duper hard. What's not hard is imagining how a humanoid robot that can fly could be even more useful. Again, there's that whole getting it to actually work thing, but it's not completely crazy to do some of the foundational research to see what might eventually be possible.
Design of a Flying Humanoid Robot Based on Thrust Vector Control, by Yuhang Li, Yuhao Zhou, Junbin Huang, Zijun Wang, Shunjie Zhu, Kairong Wu, Li Zheng, Jiajin Luo, Rui Cao, Yun Zhang, and Zhifeng Huang, from Guangdong University of Technology, is available on arXiv. Continue reading

Posted in Human Robots

#439678 Video Friday: Afghan Girls Robotics Team ...

Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We'll also be posting a weekly calendar of upcoming robotics events for the next few months; here's what we have so far (send us your events!):

DARPA SubT Finals – September 21-23, 2021 – Louisville, KY, USAWeRobot 2021 – September 23-25, 2021 – [Online Event]IROS 2021 – September 27-1, 2021 – [Online Event]ROSCon 2021 – October 20-21, 2021 – [Online Event]Let us know if you have suggestions for next week, and enjoy today's videos.
Five members of an all-girl Afghan robotics team have arrived in Mexico, fleeing an uncertain future at home after the recent collapse of the U.S.-backed government and takeover by the Taliban.
[ Reuters ] via [ FIRST Mexico ]
Thanks, Fan!
As far as autonomous cars are concerned, there's suburban Arizona difficulty, San Francisco difficulty, and then Asia rush hour difficulty. This is a 9:38 long video that is actually worth watching in its entirety because it's a fully autonomous car from AutoX driving through a Shenzhen urban village. Don't miss the astonished pedestrians, the near-miss with a wandering dog, and the comically one-sided human-vehicle interaction on a single lane road.

The AutoX Gen5 system has 50 sensors in total, as well as a vehicle control unit of 2200 TOPS computing power. There are 28 cameras capturing a total of 220 million pixels per second, six high-resolution LiDAR offering 15 million points per second, and 4D RADAR with 0.9-degree resolution encompassing a 360-degree view around the vehicle. Using cameras and LiDAR fusion perception blind spot modules, the Gen5 system covers the entire RoboTaxi body with zero blind spots.[ AutoX ]
Sometimes, robots do nice things for humans.

[ US Soccer ]
Body babbling? Body babbling.

[ CVUT ]
Thanks, Fan!
Matias from the Oxford Robotics Institute writes, “This is a demonstration of our safe visual teach and repeat navigation system running on the ANYmal robot in the Corsham mines/former Cold War bunker in the UK. This is part of some testing we've been doing for the DARPA SubT challenge as part of the Cerberus team.”

[ Oxford Robotics ]
Thanks, Matias!
We built a robotic chess player with a universal robot UR5e, a 2D camera, and a deep-learning neural network to illustrate what we do at the Mechatronics, Automation, and Control System Lab at the University of Washington.
[ MACS Lab ] via [ UW Engineering ]
Thanks, Sarah!
Autonomous inspection of powerlines with quadrotors is challenging. Flights require persistent perception to keep a close look at the lines. We propose a method that uses event cameras to robustly track powerlines. The performance is evaluated in real-world flights along a powerline. The tracker is able to persistently track the powerlines, with a mean lifetime of the line 10x longer than existing approaches.
[ ETHZ ]
I could totally do this, I just choose not to.

[ Flexiv ]
Thanks, Yunfan!
Drone Badminton enables people with low vision to play badminton again using a drone as a ball. This has the potential to diversify the physical activity for people with low vision.
[ Digital Nature Group ]
Even with the batteries installed, the Open Dynamic Robot Initiative's quadruped is still super skinny looking.

[ ODRI ]
At USC's Center for Advanced Manufacturing, we have developed a space for multidisciplinary human-robot interaction. The Baxter robot collaborates with the user to execute their own customizable tie-dye design.
[ USC Viterbi ]
I will never understand the impulse that marketing folks have to add bizarre motor noises to robot videos.

[ DeepRobotics ]
FedEx and Berkshire Grey have teamed up to streamline small package processing.
[ FedEx ]
ABB robot amalyzing COVID tests in a fully automated, unmanned state, back and forth between the stations Assist in the delivery of specimens between points, 24 hours a day, 24 hours a day, test results of 96 specimens can be completed every 60 minutes, processing more than 1,800 specimens per day.
[ ABB ]
Thanks, Fan!
This is, and I quote, “the best and greatest robot death scene of all time.”

[ The Black Hole ]
Thanks, Mark!
Audrow Nash interviews Melonee Wise for the Sense Think Act podcast.

[ Sense Think Act ]
Tom Galluzzo interviews Andrew Thomaz for the Crazy Hard Robots podcast.

[ Crazy Hard Robots ] Continue reading

Posted in Human Robots