Tag Archives: years
Gene Therapy Might Have Its First Blockbuster
Antonio Regalado | MIT Technology Review
“…drug giant Novartis expects to win approval to launch what it says will be the first ‘blockbuster’ gene-replacement treatment. A blockbuster is any drug with more than $1 billion in sales each year. The treatment, called Zolgensma, is able to save infants born with spinal muscular atrophy (SMA) type 1, a degenerative disease that usually kills within two years.”
AI Took a Test to Detect Lung Cancer. It Got an A.
Denise Grady | The New York Times
“Computers were as good or better than doctors at detecting tiny lung cancers on CT scans, in a study by researchers from Google and several medical centers. The technology is a work in progress, not ready for widespread use, but the new report, published Monday in the journal Nature Medicine, offers a glimpse of the future of artificial intelligence in medicine.”
The Rise and Reign of Starship, the World’s First Robotic Delivery Provider
Luke Dormehl | Digital Trends
“[Starship’s] delivery robots have travelled a combined 200,000 miles, carried out 50,000 deliveries, and been tested in over 100 cities in 20 countries. It is a regular fixture not just in multiple neighborhoods but also university campuses.”
Elon Musk Just Ignited the Race to Build the Space Internet
Jonathan O’Callaghan | Wired
“It’s estimated that about 3.3 billion people lack access to the internet, but Elon Musk is trying to change that. On Thursday, May 23—after two cancelled launches the week before—SpaceX launched 60 Starlink satellites on a Falcon 9 rocket from Cape Canaveral, in Florida, as part of the firm’s mission to bring low-cost, high-speed internet to the world.”
The iPod of VR Is Here, and You Should Try It
Mark Wilson | Fast Company
“In nearly 15 years of writing about cutting-edge technology, I’ve never seen a single product line get so much better so fast. With [the Oculus] Quest, there are no PCs required. There are no wires to run. All you do is grab the cloth headset and pull it around your head.”
FUTURE OF FOOD
Impossible Foods’ Rising Empire of Almost Meat
Chris Ip | Engadget
“Impossible says it wants to ultimately create a parallel universe of ersatz animal products from steak to eggs. …Yet as Impossible ventures deeper into the culinary uncanny valley, it also needs society to discard a fundamental cultural idea that dates back millennia and accept a new truth: Meat doesn’t have to come from animals.”
Can We Live Longer but Stay Younger?
Adam Gopnik | The New Yorker
“With greater longevity, the quest to avoid the infirmities of aging is more urgent than ever.”
Facial Recognition Has Already Reached Its Breaking Point
Lily Hay Newman | Wired
“As facial recognition technologies have evolved from fledgling projects into powerful software platforms, researchers and civil liberties advocates have been issuing warnings about the potential for privacy erosions. Those mounting fears came to a head Wednesday in Congress.”
Image Credit: Andrush / Shutterstock.com Continue reading
As a human you instinctively know that a leopard is closer to a cat than a motorbike, but the way we train most AI makes them oblivious to these kinds of relations. Building the concept of similarity into our algorithms could make them far more capable, writes the author of a new paper in Science Robotics.
Convolutional neural networks have revolutionized the field of computer vision to the point that machines are now outperforming humans on some of the most challenging visual tasks. But the way we train them to analyze images is very different from the way humans learn, says Atsuto Maki, an associate professor at KTH Royal Institute of Technology.
“Imagine that you are two years old and being quizzed on what you see in a photo of a leopard,” he writes. “You might answer ‘a cat’ and your parents might say, ‘yeah, not quite but similar’.”
In contrast, the way we train neural networks rarely gives that kind of partial credit. They are typically trained to have very high confidence in the correct label and consider all incorrect labels, whether ”cat” or “motorbike,” equally wrong. That’s a mistake, says Maki, because ignoring the fact that something can be “less wrong” means you’re not exploiting all of the information in the training data.
Even when models are trained this way, there will be small differences in the probabilities assigned to incorrect labels that can tell you a lot about how well the model can generalize what it has learned to unseen data.
If you show a model a picture of a leopard and it gives “cat” a probability of five percent and “motorbike” one percent, that suggests it picked up on the fact that a cat is closer to a leopard than a motorbike. In contrast, if the figures are the other way around it means the model hasn’t learned the broad features that make cats and leopards similar, something that could potentially be helpful when analyzing new data.
If we could boost this ability to identify similarities between classes we should be able to create more flexible models better able to generalize, says Maki. And recent research has demonstrated how variations of an approach called regularization might help us achieve that goal.
Neural networks are prone to a problem called “overfitting,” which refers to a tendency to pay too much attention to tiny details and noise specific to their training set. When that happens, models will perform excellently on their training data but poorly when applied to unseen test data without these particular quirks.
Regularization is used to circumvent this problem, typically by reducing the network’s capacity to learn all this unnecessary information and therefore boost its ability to generalize to new data. Techniques are varied, but generally involve modifying the network’s structure or the strength of the weights between artificial neurons.
More recently, though, researchers have suggested new regularization approaches that work by encouraging a broader spread of probabilities across all classes. This essentially helps them capture more of the class similarities, says Maki, and therefore boosts their ability to generalize.
One such approach was devised in 2017 by Google Brain researchers, led by deep learning pioneer Geoffrey Hinton. They introduced a penalty to their training process that directly punished overconfident predictions in the model’s outputs, and a technique called label smoothing that prevents the largest probability becoming much larger than all others. This meant the probabilities were lower for correct labels and higher for incorrect ones, which was found to boost performance of models on varied tasks from image classification to speech recognition.
Another came from Maki himself in 2017 and achieves the same goal, but by suppressing high values in the model’s feature vector—the mathematical construct that describes all of an object’s important characteristics. This has a knock-on effect on the spread of output probabilities and also helped boost performance on various image classification tasks.
While it’s still early days for the approach, the fact that humans are able to exploit these kinds of similarities to learn more efficiently suggests that models that incorporate them hold promise. Maki points out that it could be particularly useful in applications such as robotic grasping, where distinguishing various similar objects is important.
Image Credit: Marianna Kalashnyk / Shutterstock.com Continue reading