Tag Archives: the

#439284 A system to benchmark the posture ...

In recent years, roboticists have developed a wide variety of robots with human-like capabilities. This includes robots with bodies that structurally resemble those of humans, also known as humanoid robots. Continue reading

Posted in Human Robots

#439280 Google and Harvard Unveil the Largest ...

Last Tuesday, teams from Google and Harvard published an intricate map of every cell and connection in a cubic millimeter of the human brain.

The mapped region encompasses the various layers and cell types of the cerebral cortex, a region of brain tissue associated with higher-level cognition, such as thinking, planning, and language. According to Google, it’s the largest brain map at this level of detail to date, and it’s freely available to scientists (and the rest of us) online. (Really. Go here. Take a stroll.)

To make the map, the teams sliced donated tissue into 5,300 sections, each 30 nanometers thick, and imaged them with a scanning electron microscope at a resolution of 4 nanometers. The resulting 225 million images were computationally aligned and stitched back into a 3D digital representation of the region. Machine learning algorithms segmented individual cells and classified synapses, axons, dendrites, cells, and other structures, and humans checked their work. (The team posted a pre-print paper about the map on bioArxiv.)

Last year, Google and the Janelia Research Campus of the Howard Hughes Medical Institute made headlines when they similarly mapped a portion of a fruit fly brain. That map, at the time the largest yet, covered some 25,000 neurons and 20 million synapses. In addition to targeting the human brain, itself of note, the new map includes tens of thousands of neurons and 130 million synapses. It takes up 1.4 petabytes of disk space.

By comparison, over three decades’ worth of satellite images of Earth by NASA’s Landsat program require 1.3 petabytes of storage. Collections of brain images on the smallest scales are like “a world in a grain of sand,” the Allen Institute’s Clay Reid told Nature, quoting William Blake in reference to an earlier map of the mouse brain.

All that, however, is but a millionth of the human brain. Which is to say, a similarly detailed map of the entire thing is yet years away. Still, the work shows how fast the field is moving. A map of this scale and detail would have been unimaginable a few decades ago.

How to Map a Brain
The study of the brain’s cellular circuitry is known as connectomics.

Obtaining the human connectome, or the wiring diagram of a whole brain, is a moonshot akin to the human genome. And like the human genome, at first, it seemed an impossible feat.

The only complete connectomes are for simple creatures: the nematode worm (C. elegans) and the larva of a sea creature called C. intestinalis. There’s a very good reason for that. Until recently, the mapping process was time-consuming and costly.

Researchers mapping C. elegans in the 1980s used a film camera attached to an electron microscope to image slices of the worm, then reconstructed the neurons and synaptic connections by hand, like a maddeningly difficult three-dimensional puzzle. C. elegans has only 302 neurons and roughly 7,000 synapses, but the rough draft of its connectome took 15 years, and a final draft took another 20. Clearly, this approach wouldn’t scale.

What’s changed? In short, automation.

These days the images themselves are, of course, digital. A process known as focused ion beam milling shaves down each slice of tissue a few nanometers at a time. After one layer is vaporized, an electron microscope images the newly exposed layer. The imaged layer is then shaved away by the ion beam and the next one imaged, until all that’s left of the slice of tissue is a nanometer-resolution digital copy. It’s a far cry from the days of Kodachrome.

But maybe the most dramatic improvement is what happens after scientists complete that pile of images.

Instead of assembling them by hand, algorithms take over. Their first job is ordering the imaged slices. Then they do something impossible until the last decade. They line up the images just so, tracing the path of cells and synapses between them and thus building a 3D model. Humans still proofread the results, but they don’t do the hardest bit anymore. (Even the proofreading can be refined. Renowned neuroscientist and connectomics proponent Sebastian Seung, for example, created a game called Eyewire, where thousands of volunteers review structures.)

“It’s truly beautiful to look at,” Harvard’s Jeff Lichtman, whose lab collaborated with Google on the new map, told Nature in 2019. The programs can trace out neurons faster than the team can churn out image data, he said. “We’re not able to keep up with them. That’s a great place to be.”

But Why…?
In a 2010 TED talk, Seung told the audience you are your connectome. Reconstruct the connections and you reconstruct the mind itself: memories, experience, and personality.

But connectomics has not been without controversy over the years.

Not everyone believes mapping the connectome at this level of detail is necessary for a deep understanding of the brain. And, especially in the field’s earlier, more artisanal past, researchers worried the scale of resources required simply wouldn’t yield comparably valuable (or timely) results.

“I don’t need to know the precise details of the wiring of each cell and each synapse in each of those brains,” nueroscientist Anthony Movshon said in 2019. “What I need to know, instead, is the organizational principles that wire them together.” These, Movshon believes, can likely be inferred from observations at lower resolutions.

Also, a static snapshot of the brain’s physical connections doesn’t necessarily explain how those connections are used in practice.

“A connectome is necessary, but not sufficient,” some scientists have said over the years. Indeed, it may be in the combination of brain maps—including functional, higher-level maps that track signals flowing through neural networks in response to stimuli—that the brain’s inner workings will be illuminated in the sharpest detail.

Still, the C. elegans connectome has proven to be a foundational building block for neuroscience over the years. And the growing speed of mapping is beginning to suggest goals that once seemed impractical may actually be within reach in the coming decades.

Are We There Yet?
Seung has said that when he first started out he estimated it’d take a million years for a person to manually trace all the connections in a cubic millimeter of human cortex. The whole brain, he further inferred, would take on the order of a trillion years.

That’s why automation and algorithms have been so crucial to the field.

Janelia’s Gerry Rubin told Stat he and his team have overseen a 1,000-fold increase in mapping speed since they began work on the fruit fly connectome in 2008. The full connectome—the first part of which was completed last year—may arrive in 2022.

Other groups are working on other animals, like octopuses, saying comparing how different forms of intelligence are wired up may prove particularly rich ground for discovery.

The full connectome of a mouse, a project already underway, may follow the fruit fly by the end of the decade. Rubin estimates going from mouse to human would need another million-fold jump in mapping speed. But he points to the trillion-fold increase in DNA sequencing speed since 1973 to show such dramatic technical improvements aren’t unprecedented.

The genome may be an apt comparison in another way too. Even after sequencing the first human genome, it’s taken many years to scale genomics to the point we can more fully realize its potential. Perhaps the same will be true of connectomics.

Even as the technology opens new doors, it may take time to understand and make use of all it has to offer.

“I believe people were impatient about what [connectomes] would provide,” Joshua Vogelstein, cofounder of the Open Connetome Project, told the Verge last year. “The amount of time between a good technology being seeded, and doing actual science using that technology is often approximately 15 years. Now it’s 15 years later and we can start doing science.”

Proponents hope brain maps will yield new insights into how the brain works—from thinking to emotion and memory—and how to better diagnose and treat brain disorders. Others, Google among them no doubt, hope to glean insights that could lead to more efficient computing (the brain is astonishing in this respect) and powerful artificial intelligence.

There’s no telling exactly what scientists will find as, neuron by synapse, they map the inner workings of our minds—but it seems all but certain great discoveries await.

Image Credit: Google / Harvard Continue reading

Posted in Human Robots

#439275 This Week’s Awesome Tech Stories From ...

ARTIFICIAL INTELLIGENCE
China’s Gigantic Multi-Modal AI Is No One-Trick Pony
A. Tarantola | Engadget
“When Open AI’s GPT-3 model made its debut in May of 2020, its performance was widely considered to be the literal state of the art. …But oh what a difference a year makes. Researchers from the Beijing Academy of Artificial Intelligence announced on Tuesday the release of their own generative deep learning model, Wu Dao, a mammoth AI seemingly capable of doing everything GPT-3 can do, and more.”

TRANSPORTATION
United Airlines Wants to Bring Back Supersonic Air Travel
Lauren Hirsch | The New York Times
“…United Airlines said it was ordering 15 jets that can travel faster than the speed of sound from Boom Supersonic, a start-up in Denver. …Boom, which has raised $270 million from venture capital firms and other investors, said it planned to introduce aircraft in 2025 and start flight tests in 2026. It expects the plane, which it calls the Overture, to carry passengers before the end of the decade.”

SPACE
Spacex Signs ‘Blockbuster Deal’ To Send Space Tourists to the ISS
Amanda Kooser | CNET
“On Wednesday, space tourism company Axiom Space announced a ‘blockbuster deal’ with SpaceX that will send private crews to the ISS through 2023. Axiom and SpaceX already had a deal in place for a Dragon spacecraft flight with three private citizens and former NASA astronaut Michael López-Alegría in early 2022. The new agreement expands the scope to a total of four flights.”

TRANSPORTATION
Why Electric Cars Will Take Over Sooner Than You Think
Justin Rowlatt | BBC News
“This isn’t a fad, this isn’t greenwashing. Yes, the fact many governments around the world are setting targets to ban the sale of petrol and diesel vehicles gives impetus to the process. But what makes the end of the internal combustion engine inevitable is a technological revolution. And technological revolutions tend to happen very quickly.”

ETHICS
Have Autonomous Robots Started Killing in War?
James Vincent | The Verge
“…over the past week, a number of publications tentatively declared, based on a UN report from the Libyan civil war, that killer robots may have hunted down humans autonomously for the first time. As one headline put it: ‘The Age of Autonomous Killer Robots May Already Be Here.’ But is it? As you might guess, it’s a hard question to answer.”

ENERGY
Chart: Behind the Three-Decade Collapse of Lithium-Ion Battery Costs
Rahul Rao | IEEE Spectrum
“Between 1991 and 2018, the average price of the batteries that power mobile phones, fuel electric cars, and underpin green energy storage fell more than thirtyfold, according to work by Micah Ziegler Jessika Trancik and at the Massachusetts Institute of Technology. …Batteries today, the researchers say, have mass-production scales and energy densities unthinkable 30 years ago.”

HEALTH
The UK Has a Plan for a New ‘Pandemic Radar’ System
Maryn McKenna | Wired
“i‘What we really need is a broadly distributed, high-fidelity, always-on surveillance system…’ says Samuel V. Scarpino, an assistant professor at Northeastern University who directs its Emergent Epidemics Lab. ‘This is not something that can be built easily. But we have a narrow window right now, where basically the whole planet knows that we need to solve this.’i”

INTERFACES
Vilnius, Lithuania Built a ‘Portal’ to Another City To Help Keep People Connected
Kim Lyons | The Verge
“They really went all-in on the idea and the design; it looks quite a bit like something out of the erstwhile sci-fi movie/show Stargate. …The portals both have large screens and cameras that broadcast live images between the two cities—a kind of digital bridge, according to its creators—meant to encourage people to ‘rethink the meaning of unity,’ Go Vilnius said in a press release. Aw.”

SECURITY
Amazon Devices Will Soon Automatically Share Your Internet With Neighbors
Dan Goodin | Ars Technica
“Amazon’s experimental wireless mesh networking turns users into guinea pigs. …By default, a variety of Amazon devices will enroll in the system come June 8. And since only a tiny fraction of people take the time to change default settings, that means millions of people will be co-opted into the program whether they know anything about it or not.”

Image Credit: Praewthida K / Unsplash Continue reading

Posted in Human Robots

#439252 The Cheetah’s Fluffy Tail Points ...

Almost but not quite a decade ago, researchers from UC Berkeley equipped a little robotic car with an actuated metal rod with a weight on the end and used it to show how lizards use their tails to stabilize themselves while jumping through the air. That research inspired a whole bunch of other tailed mobile robots, including a couple of nifty ones from Amir Patel at the University of Cape Town.

The robotic tails that we’ve seen are generally actuated inertial tails: a moving mass that goes one way causes the robot that it’s attached to to go the other way. This is how lizard tails work, and it’s a totally fine way to do things. In fact, people generally figured that many if not most other animals that use their tails to improve their agility leverage this inertial principle, including (most famously) the cheetah. But at least as far as the cheetah was concerned, nobody had actually bothered to check, until Patel took the tails from a collection of ex-cheetahs and showed that in fact cheetah tails are almost entirely fluff. So if it’s not the mass of its tail that helps a cheetah chase down prey, then it must be the aerodynamics.

The internet is full of wisdom on cheetah tails, and most of it describes “heavy” tails that “act as a counterbalance” to the rest of the cheetah’s body. This makes intuitive sense, but it’s also quite wrong, as Amir Patel figured out:

The aerodynamics of cheetah tails are super important, and actually something I discovered by accident! Towards the end of my PhD I was invited to a cheetah autopsy at the National Zoological Gardens here in South Africa. The idea was to weigh and measure the inertia of the cheetah tail because no such data existed. Based on what I’d seen in wildlife documentaries (and speaking to any game ranger in South Africa), the cheetah tail is often considered to be heavy, and used as a counterweight.

However, once we removed the fur and skin from the tail during the autopsy, it was surprisingly skinny! We measured it (and the tails of another 6 cheetahs) as being only about 2 percent of the body mass—much lower than my own robotic tails. But the fur made up a significant volume of the tail. So, I figured that there must be something to it: maybe the fur was making the tail appear like a larger object aerodynamically, without the weight penalty of an inertial tail.

A few years ago, Patel started to characterize tail aerodynamics in partnership with Aaron Johnson’s lab at CMU, and that work has lead to a recent paper published in IEEE Transactions on Robotics, exploring how aerodynamic drag on a lightweight tail can help robots perform dynamic behaviors more successfully.

The specific tail design that Minitaur is sporting in the video above doesn’t look particularly cheetah-like, being made out of carbon fiber and polyethylene film rather than floof, and only sporting an aerodynamic component at the end of the tail rather than tip to butt. This is explained by cheetahs in the wild not having easy access to either carbon fiber or polyethylene, and by a design that the researchers optimized to maximize drag while minimizing mass rather than for biomimicry. “We experimented with a whole array of furry tails to mimic cheetah fur, but found that the half cylinder shape had by far the most drag,” first author Joseph Norby told us in an email. “And the reduction of the drag component to just the end of the tail was a balance of effectiveness and rigidity—we could have made the drag component cover the entire length, but really the section near the tip produces most of the drag, and reducing the length of the drag component helps maintain the shape of the tail.”

Aerodynamic tails are potentially appealing because unlike inertial tails, the amount of torque that they can produce doesn't depend on how much they weigh, but rather with the velocity at which the robot is moving: the faster the robot goes, the more torque an aerodynamic tail can produce. We see this in animals, too, with fluffy tails commonly found on fast movers and jumpers like jerboas and flying squirrels. This offers some suggestion about what kind of robots could benefit most from tails like these, although as Norby points out, the greatest limitation of these tails is the large workspace required for the tail to move around safely.

Image: Norby et al

A variety of animals (and one robot) with aerodynamic drag tails, including a jerboa and giant Indian squirrel.

While this paper is focused on quantifying the effects of aerodynamic drag on robotic tails, it seems like there’s a lot of potential for some really creative designs—we were wondering about tails with adjustable floofitude, for example, and we asked Norby about some ways in which this research might be extended.

I think a foldable or retractable tail would greatly improve practicality by reducing the workspace when the tail is not needed. Essentially all of the animals we studied had some sort of flexibility to their tails, which I believe is a crucial property for improving both practicality and durability. In a similar vein, we've also thought about employing active or passive designs that could quickly modify the drag coefficient, whether by furling and unfurling, or simply rotating an asymmetric tail like our half cylinder. This could perhaps allow new forms of control similar to paddling and feathering a canoe: increasing drag when moving in one direction and reducing drag in the other could allow for more net control authority. This would be completely impossible with an inertial tail, which cannot do work on the environment.

Photo: Evan Ackerman/IEEE Spectrum

Gratuitous cheetah picture.

Even though animals had the idea for lightweight aerodynamic drag tails first, there’s no reason why we need to restrict ourselves to animal-like form factors when leveraging the advantages that tails like these offer, or indeed with the designs of the tails themselves. Without a mass penalty to worry about, why not put tails on any robot that has trouble keeping its balance, like pretty much every bipedal robot, right? Of course there are plenty of reasons not to do this, but still, it’s exciting to see this whole design space of aerodynamic drag tails potentially open up for any robot platform that needs a little bit of help with dynamic motion.

Enabling Dynamic Behaviors With Aerodynamic Drag in Lightweight Tails, by Joseph Norby, Jun Yang Li, Cameron Selby, Amir Patel, and Aaron M. Johnson from CMU and the University of Cape Town is published in IEEE Transactions on Robotics. Continue reading

Posted in Human Robots

#439251 Is AI the Future of Training for New ...

Everywhere you look in technology today, you find buzz about the promise of emergent technologies such as machine learning (ML) and artificial intelligence (AI). From curating the content that we watch on streaming services to finding ways to improve intense logistical processes, ML- and AI-based technologies already impact our lives in many ways. Increasingly, these …

The post Is AI the Future of Training for New Employees? appeared first on TFOT. Continue reading

Posted in Human Robots