Tag Archives: guide
Making sure artificial intelligence does what we want and behaves in predictable ways will be crucial as the technology becomes increasingly ubiquitous. It’s an area frequently neglected in the race to develop products, but DeepMind has now outlined its research agenda to tackle the problem.
AI safety, as the field is known, has been gaining prominence in recent years. That’s probably at least partly down to the overzealous warnings of a coming AI apocalypse from well-meaning, but underqualified pundits like Elon Musk and Stephen Hawking. But it’s also recognition of the fact that AI technology is quickly pervading all aspects of our lives, making decisions on everything from what movies we watch to whether we get a mortgage.
That’s why DeepMind hired a bevy of researchers who specialize in foreseeing the unforeseen consequences of the way we built AI back in 2016. And now the team has spelled out the three key domains they think require research if we’re going to build autonomous machines that do what we want.
In a new blog designed to provide updates on the team’s work, they introduce the ideas of specification, robustness, and assurance, which they say will act as the cornerstones of their future research. Specification involves making sure AI systems do what their operator intends; robustness means a system can cope with changes to its environment and attempts to throw it off course; and assurance involves our ability to understand what systems are doing and how to control them.
A classic thought experiment designed to illustrate how we could lose control of an AI system can help illustrate the problem of specification. Philosopher Nick Bostrom’s posited a hypothetical machine charged with making as many paperclips as possible. Because the creators fail to add what they might assume are obvious additional goals like not harming people, the AI wipes out humanity so we can’t switch it off before turning all matter in the universe into paperclips.
Obviously the example is extreme, but it shows how a poorly-specified goal can lead to unexpected and disastrous outcomes. Properly codifying the desires of the designer is no easy feat, though; often there are not neat ways to encompass both the explicit and implicit goals in ways that are understandable to the machine and don’t leave room for ambiguities, meaning we often rely on incomplete approximations.
The researchers note recent research by OpenAI in which an AI was trained to play a boat-racing game called CoastRunners. The game rewards players for hitting targets laid out along the race route. The AI worked out that it could get a higher score by repeatedly knocking over regenerating targets rather than actually completing the course. The blog post includes a link to a spreadsheet detailing scores of such examples.
Another key concern for AI designers is making their creation robust to the unpredictability of the real world. Despite their superhuman abilities on certain tasks, most cutting-edge AI systems are remarkably brittle. They tend to be trained on highly-curated datasets and so can fail when faced with unfamiliar input. This can happen by accident or by design—researchers have come up with numerous ways to trick image recognition algorithms into misclassifying things, including thinking a 3D printed tortoise was actually a gun.
Building systems that can deal with every possible encounter may not be feasible, so a big part of making AIs more robust may be getting them to avoid risks and ensuring they can recover from errors, or that they have failsafes to ensure errors don’t lead to catastrophic failure.
And finally, we need to have ways to make sure we can tell whether an AI is performing the way we expect it to. A key part of assurance is being able to effectively monitor systems and interpret what they’re doing—if we’re basing medical treatments or sentencing decisions on the output of an AI, we’d like to see the reasoning. That’s a major outstanding problem for popular deep learning approaches, which are largely indecipherable black boxes.
The other half of assurance is the ability to intervene if a machine isn’t behaving the way we’d like. But designing a reliable off switch is tough, because most learning systems have a strong incentive to prevent anyone from interfering with their goals.
The authors don’t pretend to have all the answers, but they hope the framework they’ve come up with can help guide others working on AI safety. While it may be some time before AI is truly in a position to do us harm, hopefully early efforts like these will mean it’s built on a solid foundation that ensures it is aligned with our goals.
Image Credit: cono0430 / Shutterstock.com Continue reading
Now that the era of artificial intelligence is unquestionably upon us, it behooves us to think and work harder to ensure that the AIs we create embody positive human values.
Science fiction is full of AIs that manifest the dark side of humanity, or are indifferent to humans altogether. Such possibilities cannot be ruled out, but nor is there any logical or empirical reason to consider them highly likely. I am among a large group of AI experts who see a strong potential for profoundly positive outcomes in the AI revolution currently underway.
We are facing a future with great uncertainty and tremendous promise, and the best we can do is to confront it with a combination of heart and mind, of common sense and rigorous science. In the realm of AI, what this means is, we need to do our best to guide the AI minds we are creating to embody the values we cherish: love, compassion, creativity, and respect.
The quest for beneficial AI has many dimensions, including its potential to reduce material scarcity and to help unlock the human capacity for love and compassion.
A large percentage of difficult issues in human society, many of which spill over into the AI domain, would be palliated significantly if material scarcity became less of a problem. Fortunately, AI has great potential to help here. AI is already increasing efficiency in nearly every industry.
In the next few decades, as nanotech and 3D printing continue to advance, AI-driven design will become a larger factor in the economy. Radical new tools like artificial enzymes built using Christian Schafmeister’s spiroligomer molecules, and designed using quantum physics-savvy AIs, will enable the creation of new materials and medicines.
For amazing advances like the intersection of AI and nanotech to lead toward broadly positive outcomes, however, the economic and political aspects of the AI industry may have to shift from the current status quo.
Currently, most AI development occurs under the aegis of military organizations or large corporations oriented heavily toward advertising and marketing. Put crudely, an awful lot of AI today is about “spying, brainwashing, or killing.” This is not really the ideal situation if we want our first true artificial general intelligences to be open-minded, warm-hearted, and beneficial.
Also, as the bulk of AI development now occurs in large for-profit organizations bound by law to pursue the maximization of shareholder value, we face a situation where AI tends to exacerbate global wealth inequality and class divisions. This has the potential to lead to various civilization-scale failure modes involving the intersection of geopolitics, AI, cyberterrorism, and so forth. Part of my motivation for founding the decentralized AI project SingularityNET was to create an alternative mode of dissemination and utilization of both narrow AI and AGI—one that operates in a self-organizing way, outside of the direct grip of conventional corporate and governmental structures.
In the end, though, I worry that radical material abundance and novel political and economic structures may fail to create a positive future, unless they are coupled with advances in consciousness and compassion. AGIs have the potential to be massively more ethical and compassionate than humans. But still, the odds of getting deeply beneficial AGIs seem higher if the humans creating them are fuller of compassion and positive consciousness—and can effectively pass these values on.
Transmitting Human Values
Brain-computer interfacing is another critical aspect of the quest for creating more positive AIs and more positive humans. As Elon Musk has put it, “If you can’t beat ’em, join’ em.” Joining is more fun than beating anyway. What better way to infuse AIs with human values than to connect them directly to human brains, and let them learn directly from the source (while providing humans with valuable enhancements)?
Millions of people recently heard Elon Musk discuss AI and BCI on the Joe Rogan podcast. Musk’s embrace of brain-computer interfacing is laudable, but he tends to dodge some of the tough issues—for instance, he does not emphasize the trade-off cyborgs will face between retaining human-ness and maximizing intelligence, joy, and creativity. To make this trade-off effectively, the AI portion of the cyborg will need to have a deep sense of human values.
Musk calls humanity the “biological boot loader” for AGI, but to me this colorful metaphor misses a key point—that we can seed the AGI we create with our values as an initial condition. This is one reason why it’s important that the first really powerful AGIs are created by decentralized networks, and not conventional corporate or military organizations. The decentralized software/hardware ecosystem, for all its quirks and flaws, has more potential to lead to human-computer cybernetic collective minds that are reasonable and benevolent.
BCI is still in its infancy, but a more immediate way of connecting people with AIs to infuse both with greater love and compassion is to leverage humanoid robotics technology. Toward this end, I conceived a project called Loving AI, focused on using highly expressive humanoid robots like the Hanson robot Sophia to lead people through meditations and other exercises oriented toward unlocking the human potential for love and compassion. My goals here were to explore the potential of AI and robots to have a positive impact on human consciousness, and to use this application to study and improve the OpenCog and SingularityNET tools used to control Sophia in these interactions.
The Loving AI project has now run two small sets of human trials, both with exciting and positive results. These have been small—dozens rather than hundreds of people—but have definitively proven the point. Put a person in a quiet room with a humanoid robot that can look them in the eye, mirror their facial expressions, recognize some of their emotions, and lead them through simple meditation, listening, and consciousness-oriented exercises…and quite a lot of the time, the result is a more relaxed person who has entered into a shifted state of consciousness, at least for a period of time.
In a certain percentage of cases, the interaction with the robot consciousness guide triggered a dramatic change of consciousness in the human subject—a deep meditative trance state, for instance. In most cases, the result was not so extreme, but statistically the positive effect was quite significant across all cases. Furthermore, a similar effect was found using an avatar simulation of the robot’s face on a tablet screen (together with a webcam for facial expression mirroring and recognition), but not with a purely auditory interaction.
The Loving AI experiments are not only about AI; they are about human-robot and human-avatar interaction, with AI as one significant aspect. The facial interaction with the robot or avatar is pushing “biological buttons” that trigger emotional reactions and prime the mind for changes of consciousness. However, this sort of body-mind interaction is arguably critical to human values and what it means to be human; it’s an important thing for robots and AIs to “get.”
Halting or pausing the advance of AI is not a viable possibility at this stage. Despite the risks, the potential economic and political benefits involved are clear and massive. The convergence of narrow AI toward AGI is also a near inevitability, because there are so many important applications where greater generality of intelligence will lead to greater practical functionality. The challenge is to make the outcome of this great civilization-level adventure as positive as possible.
Image Credit: Anton Gvozdikov / Shutterstock.com Continue reading
Shanghai is a city full of life. With its population of 24 million, Shanghai embraces vibrant growth, fosters rising diversity, and attracts visionaries, innovators, and adventurers. Fintech, artificial intelligence, and e-commerce are booming. Now is a great time to explore this multicultural, inspirational city as it experiences quick growth and ever greater influence.
Meet Your Guide
Qingsong (Dora) Ke
Singularity University Chapter: Shanghai Chapter
Profession: Associate Director for Asia Pacific, IE Business School and IE University; Mentor, Techstars Startup Weekend; Mentor, Startupbootcamp; China President, Her Century
Your City Guide to Shanghai, China
Top three industries in the city: Automotive, Retail, and Finance
1. Coworking Space: Mixpace
With 10 convenient locations in the Shanghai downtown area, Mixpace offers affordable prices and various office and event spaces to both foreign and local entrepreneurs and startups.
2. Makerspace: XinCheJian
The first hackerspace and a non-profit in China, Xinchejian was founded to support projects in physical computing, open source hardware, and the Internet of Things. It hosts regular events and talks to facilitate development of hackerspaces in China.
3. Local meetups/ networks: FinTech Connector
FinTech Connector is a community connecting local fintech entrepreneurs and start-ups with global professionals, thought leaders, and investors for the purpose of disrupting financial services with cutting-edge technology.
4. Best coffee shop with free WiFi: Seesaw
Clean and modern décor, convenient locations, a quiet environment, and high-quality coffee make Seesaw one of the most popular coffee shops in Shanghai.
5. The startup neighborhood: Knowledge & Innovation Community (KIC)
Located near 10 prestigious universities and over 100 scientific research institutions, KIC attempts to integrate Silicon Valley’s innovative spirit with the artistic culture of the Left Bank in Paris.
6. Well-known investor or venture capitalist: Nanpeng (Neil) Shen
Global executive partner at Sequoia Capital, founding and managing partner at Sequoia China, and founder of Ctrip.com and Home Inn, Neil Shen was named Best Venture Capitalist by Forbes China in 2010–2013 and ranked as the best Chinese investor among Global Best Investors by Forbes in 2012–2016.
7. Best way to get around: Metro
Shanghai’s 17 well-connected metro lines covering every corner of the city at affordable prices are the best way to get around.
8. Local must-have dish and where to get it: Mini Soupy Bun (steamed dumplings, xiaolongbao) at Din Tai Fung in Shanghai.
Named one of the top ten restaurants in the world by the New York Times, Din Tai Fung makes the best xiaolongbao, a delicious soup with stuffed dumplings.
9. City’s best-kept secret: Barber Shop
This underground bar gets its name from the barber shop it’s hidden behind. Visitors must discover how to unlock the door leading to Barber Shop’s sophisticated cocktails and engaging music. (No website for this underground location, but the address is 615 Yongjia Road).
10. Touristy must-do: Enjoy the nightlife and the skyline at the Bund
On the east side of the Bund are the most modern skyscrapers, including Shanghai Tower, Shanghai World Financial Centre, and Jin Mao Tower. The west side of the Bund features 26 buildings of diverse architectural styles, including Gothic, Baroque, Romanesque, and others; this area is known for its exotic buildings.
11. Local volunteering opportunity: Shanghai Volunteer
Shanghai Volunteer is a platform to connect volunteers with possible opportunities in various fields, including education, elderly care, city culture, and environment.
12. Local University with great resources: Shanghai Jiao Tong University
Established in 1896, Shanghai Jiao Tong University is the second-oldest university in China and one of the country’s most prestigious. It boasts notable alumni in government and politics, science, engineering, business, and sports, and it regularly collaborates with government and the private sector.
This article is for informational purposes only. All opinions in this post are the author’s alone and not those of Singularity University. Neither this article nor any of the listed information therein is an official endorsement by Singularity University.
Image Credits: Qinsong (Dora) Ke
Banner Image Credit: ESB Professional / Shutterstock.com Continue reading
Researchers at IIT-Istituto Italiano di Tecnologia tested a new version of the WALK-MAN humanoid robot for supporting emergency response teams in fires. The robot is able to locate the fire and walk toward it, and then activate an extinguisher. During the operation, it collects images and transmits them back to emergency teams, who can evaluate the situation and guide the robot remotely. The new WALK-MAN design has a lighter upper body and new hands in order to reduce construction cost and improve performance. Continue reading