Tag Archives: smile

#434311 Understanding the Hidden Bias in ...

Facial recognition technology has progressed to point where it now interprets emotions in facial expressions. This type of analysis is increasingly used in daily life. For example, companies can use facial recognition software to help with hiring decisions. Other programs scan the faces in crowds to identify threats to public safety.

Unfortunately, this technology struggles to interpret the emotions of black faces. My new study, published last month, shows that emotional analysis technology assigns more negative emotions to black men’s faces than white men’s faces.

This isn’t the first time that facial recognition programs have been shown to be biased. Google labeled black faces as gorillas. Cameras identified Asian faces as blinking. Facial recognition programs struggled to correctly identify gender for people with darker skin.

My work contributes to a growing call to better understand the hidden bias in artificial intelligence software.

Measuring Bias
To examine the bias in the facial recognition systems that analyze people’s emotions, I used a data set of 400 NBA player photos from the 2016 to 2017 season, because players are similar in their clothing, athleticism, age and gender. Also, since these are professional portraits, the players look at the camera in the picture.

I ran the images through two well-known types of emotional recognition software. Both assigned black players more negative emotional scores on average, no matter how much they smiled.

For example, consider the official NBA pictures of Darren Collison and Gordon Hayward. Both players are smiling, and, according to the facial recognition and analysis program Face++, Darren Collison and Gordon Hayward have similar smile scores—48.7 and 48.1 out of 100, respectively.

Basketball players Darren Collision (left) and Gordon Hayward (right). basketball-reference.com

However, Face++ rates Hayward’s expression as 59.7 percent happy and 0.13 percent angry and Collison’s expression as 39.2 percent happy and 27 percent angry. Collison is viewed as nearly as angry as he is happy and far angrier than Hayward—despite the facial recognition program itself recognizing that both players are smiling.

In contrast, Microsoft’s Face API viewed both men as happy. Still, Collison is viewed as less happy than Hayward, with 98 and 93 percent happiness scores, respectively. Despite his smile, Collison is even scored with a small amount of contempt, whereas Hayward has none.

Across all the NBA pictures, the same pattern emerges. On average, Face++ rates black faces as twice as angry as white faces. Face API scores black faces as three times more contemptuous than white faces. After matching players based on their smiles, both facial analysis programs are still more likely to assign the negative emotions of anger or contempt to black faces.

Stereotyped by AI
My study shows that facial recognition programs exhibit two distinct types of bias.

First, black faces were consistently scored as angrier than white faces for every smile. Face++ showed this type of bias. Second, black faces were always scored as angrier if there was any ambiguity about their facial expression. Face API displayed this type of disparity. Even if black faces are partially smiling, my analysis showed that the systems assumed more negative emotions as compared to their white counterparts with similar expressions. The average emotional scores were much closer across races, but there were still noticeable differences for black and white faces.

This observation aligns with other research, which suggests that black professionals must amplify positive emotions to receive parity in their workplace performance evaluations. Studies show that people perceive black men as more physically threatening than white men, even when they are the same size.

Some researchers argue that facial recognition technology is more objective than humans. But my study suggests that facial recognition reflects the same biases that people have. Black men’s facial expressions are scored with emotions associated with threatening behaviors more often than white men, even when they are smiling. There is good reason to believe that the use of facial recognition could formalize preexisting stereotypes into algorithms, automatically embedding them into everyday life.

Until facial recognition assesses black and white faces similarly, black people may need to exaggerate their positive facial expressions—essentially smile more—to reduce ambiguity and potentially negative interpretations by the technology.

Although innovative, artificial intelligence can perpetrate and exacerbate existing power dynamics, leading to disparate impact across racial/ethnic groups. Some societal accountability is necessary to ensure fairness to all groups because facial recognition, like most artificial intelligence, is often invisible to the people most affected by its decisions.

Lauren Rhue, Assistant Professor of Information Systems and Analytics, Wake Forest University

This article is republished from The Conversation under a Creative Commons license. Read the original article.

Image Credit: Alex_Po / Shutterstock.com Continue reading

Posted in Human Robots

#433748 Could Tech Make Government As We Know It ...

Governments are one of the last strongholds of an undigitized, linear sector of humanity, and they are falling behind fast. Apart from their struggle to keep up with private sector digitization, federal governments are in a crisis of trust.

At almost a 60-year low, only 18 percent of Americans reported that they could trust their government “always” or “most of the time” in a recent Pew survey. And the US is not alone. The Edelman Trust Barometer revealed last year that 41 percent of the world population distrust their nations’ governments.

In many cases, the private sector—particularly tech—is driving greater progress in regulation-targeted issues like climate change than state leaders. And as decentralized systems, digital disruption, and private sector leadership take the world by storm, traditional forms of government are beginning to fear irrelevance. However, the fight for exponential governance is not a lost battle.

Early visionaries like Estonia and the UAE are leading the way in digital governance, empowered by a host of converging technologies.

In this article, we will cover three key trends:

Digital governance divorced from land
AI-driven service delivery and regulation
Blockchain-enforced transparency

Let’s dive in.

Governments Going Digital
States and their governments have forever been tied to physical territories, and public services are often delivered through brick-and-mortar institutions. Yet public sector infrastructure and services will soon be hosted on servers, detached from land and physical form.

Enter e-Estonia. Perhaps the least expected on a list of innovative nations, this former Soviet Republic-turned digital society is ushering in an age of technological statecraft.

Hosting every digitizable government function on the cloud, Estonia could run its government almost entirely on a server. Starting in the 1990s, Estonia’s government has covered the nation with ultra-high-speed data connectivity, laying down tremendous amounts of fiber optic cable. By 2007, citizens could vote from their living rooms.

With digitized law, Estonia signs policies into effect using cryptographically secure digital signatures, and every stage of the legislative process is available to citizens online.

Citizens’ healthcare registry is run on the blockchain, allowing patients to own and access their own health data from anywhere in the world—X-rays, digital prescriptions, medical case notes—all the while tracking who has access.

Today, most banks have closed their offices, as 99 percent of banking transactions occur online (with 67 percent of citizens regularly using cryptographically secured e-IDs). And by 2020, e-tax will be entirely automated with Estonia’s new e-Tax and Customs Board portal, allowing companies and tax authority to exchange data automatically. And i-Voting, civil courts, land registries, banking, taxes, and countless e-facilities allow citizens to access almost any government service with an electronic ID and personal PIN online.

But perhaps Estonia’s most revolutionary breakthrough is its recently introduced e-residency. With over 30,000 e-residents, Estonia issues electronic IDs to global residents anywhere in the world. While e-residency doesn’t grant territorial rights, over 5,000 e-residents have already established companies within Estonia’s jurisdiction.

After registering companies online, entrepreneurs pay automated taxes—calculated in minutes and transmitted to the Estonian government with unprecedented ease.

The implications of e-residency and digital governance are huge. As with any software, open-source code for digital governance could be copied perfectly at almost zero cost, lowering the barrier to entry for any group or movement seeking statehood.

We may soon see the rise of competitive governing ecosystems, each testing new infrastructure and public e-services to compete with mainstream governments for taxpaying citizens.

And what better to accelerate digital governance than AI?

Legal Compliance Through AI
Just last year, the UAE became the first nation to appoint a State Minister for AI (actually a friend of mine, H.E. Omar Al Olama), aiming to digitize government services and halve annual costs. Among multiple sector initiatives, the UAE hopes to deploy robotic cops by 2030.

Meanwhile, the U.K. now has a Select Committee on Artificial Intelligence, and just last month, world leaders convened at the World Government Summit to discuss guidelines for AI’s global regulation.

As AI infuses government services, emerging applications have caught my eye:

Smart Borders and Checkpoints

With biometrics and facial recognition, traditional checkpoints will soon be a thing of the past. Cubic Transportation Systems—the company behind London’s ticketless public transit—is currently developing facial recognition for automated transport barriers. Digital security company Gemalto predicts that biometric systems will soon cross-reference individual faces with passport databases at security checkpoints, and China has already begun to test this at scale. While the Alibaba Ant Financial affiliate’s “Smile to Pay” feature allows users to authenticate digital payments with their faces, nationally overseen facial recognition technologies allow passengers to board planes, employees to enter office spaces, and students to access university halls. With biometric-geared surveillance at national borders, supply chains and international travelers could be tracked automatically, and granted or denied access according to biometrics and cross-referenced databases.

Policing and Security

Leveraging predictive analytics, China is also working to integrate security footage into a national surveillance and data-sharing system. By merging citizen data in its “Police Cloud”—including everything from criminal and medical records, transaction data, travel records and social media—it may soon be able to spot suspects and predict crime in advance. But China is not alone. During London’s Notting Hill Carnival this year, the Metropolitan Police used facial recognition cross-referenced with crime data to pre-identify and track likely offenders.

Smart Courts

AI may soon be reaching legal trials as well. UCL computer scientists have developed software capable of predicting courtroom outcomes based on data patterns with unprecedented accuracy. Assessing risk of flight, the National Bureau of Economic Research now uses an algorithm leveraging data from hundreds of thousands of NYC cases to recommend whether defendants should be granted bail. But while AI allows for streamlined governance, the public sector’s power to misuse our data is a valid concern and issues with bias as a result of historical data still remain. As tons of new information is generated about our every move, how do we keep governments accountable?

Enter the blockchain.

Transparent Governance and Accountability
Without doubt, alongside AI, government’s greatest disruptor is the newly-minted blockchain. Relying on a decentralized web of nodes, blockchain can securely verify transactions, signatures, and other information. This makes it essentially impossible for hackers, companies, officials, or even governments to falsify information on the blockchain.

As you’d expect, many government elites are therefore slow to adopt the technology, fearing enforced accountability. But blockchain’s benefits to government may be too great to ignore.

First, blockchain will be a boon for regulatory compliance.

As transactions on a blockchain are irreversible and transparent, uploaded sensor data can’t be corrupted. This means middlemen have no way of falsifying information to shirk regulation, and governments eliminate the need to enforce charges after the fact.

Apply this to carbon pricing, for instance, and emission sensors could fluidly log carbon credits onto a carbon credit blockchain, such as that developed by Ecosphere+. As carbon values are added to the price of everyday products or to corporations’ automated taxes, compliance and transparency would soon be digitally embedded.

Blockchain could also bolster government efforts in cybersecurity. As supercities and nation-states build IoT-connected traffic systems, surveillance networks, and sensor-tracked supply chain management, blockchain is critical in protecting connected devices from cyberattack.

But blockchain will inevitably hold governments accountable as well. By automating and tracking high-risk transactions, blockchain may soon eliminate fraud in cash transfers, public contracts and aid funds. Already, the UN World Food Program has piloted blockchain to manage cash-based transfers and aid flows to Syrian refugees in Jordan.

Blockchain-enabled “smart contracts” could automate exchange of real assets according to publicly visible, pre-programmed conditions, disrupting the $9.5 trillion market of public-sector contracts and public investment projects.

Eliminating leakages and increasing transparency, a distributed ledger has the potential to save trillions.

Future Implications
It is truly difficult to experiment with new forms of government. It’s not like there are new countries waiting to be discovered where we can begin fresh. And with entrenched bureaucracies and dominant industrial players, changing an existing nation’s form of government is extremely difficult and usually only happens during times of crisis or outright revolution.

Perhaps we will develop and explore new forms of government in the virtual world (to be explored during a future blog), or perhaps Sea Steading will allow us to physically build new island nations. And ultimately, as we move off the earth to Mars and space colonies, we will have yet another chance to start fresh.

But, without question, 90 percent or more of today’s political processes herald back to a day before technology, and it shows in terms of speed and efficiency.

Ultimately, there will be a shift to digital governments enabled with blockchain’s transparency, and we will redefine the relationship between citizens and the public sector.

One day I hope i-voting will allow anyone anywhere to participate in policy, and cloud-based governments will start to compete in e-services. As four billion new minds come online over the next several years, people may soon have the opportunity to choose their preferred government and citizenship digitally, independent of birthplace.

In 50 years, what will our governments look like? Will we have an interplanetary order, or a multitude of publicly-run ecosystems? Will cyber-ocracies rule our physical worlds with machine intelligence, or will blockchains allow for hive mind-like democracy?

The possibilities are endless, and only we can shape them.

Join Me
Abundance-Digital Online Community: I’ve created a digital community of bold, abundance-minded entrepreneurs called Abundance-Digital. Abundance-Digital is my ‘onramp’ for exponential entrepreneurs – those who want to get involved and play at a higher level. Click here to learn more.

Image Credit: ArtisticPhoto / Shutterstock.com Continue reading

Posted in Human Robots

#433521 Humanoid robot dental “practice ...

No more inept dental trainees practising on a very reluctant and – quite likely – horrified human “volunteer”. This Simroid dental training humanoid robot will take one for the team with a smile (or what’s left of it)!

Posted in Human Robots

#432271 Your Shopping Experience Is on the Verge ...

Exponential technologies (AI, VR, 3D printing, and networks) are radically reshaping traditional retail.

E-commerce giants (Amazon, Walmart, Alibaba) are digitizing the retail industry, riding the exponential growth of computation.

Many brick-and-mortar stores have already gone bankrupt, or migrated their operations online.

Massive change is occurring in this arena.

For those “real-life stores” that survive, an evolution is taking place from a product-centric mentality to an experience-based business model by leveraging AI, VR/AR, and 3D printing.

Let’s dive in.

E-Commerce Trends
Last year, 3.8 billion people were connected online. By 2024, thanks to 5G, stratospheric and space-based satellites, we will grow to 8 billion people online, each with megabit to gigabit connection speeds.

These 4.2 billion new digital consumers will begin buying things online, a potential bonanza for the e-commerce world.

At the same time, entrepreneurs seeking to service these four-billion-plus new consumers can now skip the costly steps of procuring retail space and hiring sales clerks.

Today, thanks to global connectivity, contract production, and turnkey pack-and-ship logistics, an entrepreneur can go from an idea to building and scaling a multimillion-dollar business from anywhere in the world in record time.

And while e-commerce sales have been exploding (growing from $34 billion in Q1 2009 to $115 billion in Q3 2017), e-commerce only accounted for about 10 percent of total retail sales in 2017.

In 2016, global online sales totaled $1.8 trillion. Remarkably, this $1.8 trillion was spent by only 1.5 billion people — a mere 20 percent of Earth’s global population that year.

There’s plenty more room for digital disruption.

AI and the Retail Experience
For the business owner, AI will demonetize e-commerce operations with automated customer service, ultra-accurate supply chain modeling, marketing content generation, and advertising.

In the case of customer service, imagine an AI that is trained by every customer interaction, learns how to answer any consumer question perfectly, and offers feedback to product designers and company owners as a result.

Facebook’s handover protocol allows live customer service representatives and language-learning bots to work within the same Facebook Messenger conversation.

Taking it one step further, imagine an AI that is empathic to a consumer’s frustration, that can take any amount of abuse and come back with a smile every time. As one example, meet Ava. “Ava is a virtual customer service agent, to bring a whole new level of personalization and brand experience to that customer experience on a day-to-day basis,” says Greg Cross, CEO of Ava’s creator, an Austrian company called Soul Machines.

Predictive modeling and machine learning are also optimizing product ordering and the supply chain process. For example, Skubana, a platform for online sellers, leverages data analytics to provide entrepreneurs constant product performance feedback and maintain optimal warehouse stock levels.

Blockchain is set to follow suit in the retail space. ShipChain and Ambrosus plan to introduce transparency and trust into shipping and production, further reducing costs for entrepreneurs and consumers.

Meanwhile, for consumers, personal shopping assistants are shifting the psychology of the standard shopping experience.

Amazon’s Alexa marks an important user interface moment in this regard.

Alexa is in her infancy with voice search and vocal controls for smart homes. Already, Amazon’s Alexa users, on average, spent more on Amazon.com when purchasing than standard Amazon Prime customers — $1,700 versus $1,400.

As I’ve discussed in previous posts, the future combination of virtual reality shopping, coupled with a personalized, AI-enabled fashion advisor will make finding, selecting, and ordering products fast and painless for consumers.

But let’s take it one step further.

Imagine a future in which your personal AI shopper knows your desires better than you do. Possible? I think so. After all, our future AIs will follow us, watch us, and observe our interactions — including how long we glance at objects, our facial expressions, and much more.

In this future, shopping might be as easy as saying, “Buy me a new outfit for Saturday night’s dinner party,” followed by a surprise-and-delight moment in which the outfit that arrives is perfect.

In this future world of AI-enabled shopping, one of the most disruptive implications is that advertising is now dead.

In a world where an AI is buying my stuff, and I’m no longer in the decision loop, why would a big brand ever waste money on a Super Bowl advertisement?

The dematerialization, demonetization, and democratization of personalized shopping has only just begun.

The In-Store Experience: Experiential Retailing
In 2017, over 6,700 brick-and-mortar retail stores closed their doors, surpassing the former record year for store closures set in 2008 during the financial crisis. Regardless, business is still booming.

As shoppers seek the convenience of online shopping, brick-and-mortar stores are tapping into the power of the experience economy.

Rather than focusing on the practicality of the products they buy, consumers are instead seeking out the experience of going shopping.

The Internet of Things, artificial intelligence, and computation are exponentially improving the in-person consumer experience.

As AI dominates curated online shopping, AI and data analytics tools are also empowering real-life store owners to optimize staffing, marketing strategies, customer relationship management, and inventory logistics.

In the short term,retail store locations will serve as the next big user interface for production 3D printing (custom 3D printed clothes at the Ministry of Supply), virtual and augmented reality (DIY skills clinics), and the Internet of Things (checkout-less shopping).

In the long term,we’ll see how our desire for enhanced productivity and seamless consumption balances with our preference for enjoyable real-life consumer experiences — all of which will be driven by exponential technologies.

One thing is certain: the nominal shopping experience is on the verge of a major transformation.

Implications
The convergence of exponential technologies has already revamped how and where we shop, how we use our time, and how much we pay.

Twenty years ago, Amazon showed us how the web could offer each of us the long tail of available reading material, and since then, the world of e-commerce has exploded.

And yet we still haven’t experienced the cost savings coming our way from drone delivery, the Internet of Things, tokenized ecosystems, the impact of truly powerful AI, or even the other major applications for 3D printing and AR/VR.

Perhaps nothing will be more transformed than today’s $20 trillion retail sector.

Hold on, stay tuned, and get your AI-enabled cryptocurrency ready.

Join Me
Abundance Digital Online Community: I’ve created a digital/online community of bold, abundance-minded entrepreneurs called Abundance Digital.

Abundance Digital is my ‘onramp’ for exponential entrepreneurs — those who want to get involved and play at a higher level. Click here to learn more.

Image Credit: Zapp2Photo / Shutterstock.com Continue reading

Posted in Human Robots

#431389 Tech Is Becoming Emotionally ...

Many people get frustrated with technology when it malfunctions or is counterintuitive. The last thing people might expect is for that same technology to pick up on their emotions and engage with them differently as a result.
All of that is now changing. Computers are increasingly able to figure out what we’re feeling—and it’s big business.
A recent report predicts that the global affective computing market will grow from $12.2 billion in 2016 to $53.98 billion by 2021. The report by research and consultancy firm MarketsandMarkets observed that enabling technologies have already been adopted in a wide range of industries and noted a rising demand for facial feature extraction software.
Affective computing is also referred to as emotion AI or artificial emotional intelligence. Although many people are still unfamiliar with the category, researchers in academia have already discovered a multitude of uses for it.
At the University of Tokyo, Professor Toshihiko Yamasaki decided to develop a machine learning system that evaluates the quality of TED Talk videos. Of course, a TED Talk is only considered to be good if it resonates with a human audience. On the surface, this would seem too qualitatively abstract for computer analysis. But Yamasaki wanted his system to watch videos of presentations and predict user impressions. Could a machine learning system accurately evaluate the emotional persuasiveness of a speaker?
Yamasaki and his colleagues came up with a method that analyzed correlations and “multimodal features including linguistic as well as acoustic features” in a dataset of 1,646 TED Talk videos. The experiment was successful. The method obtained “a statistically significant macro-average accuracy of 93.3 percent, outperforming several competitive baseline methods.”
A machine was able to predict whether or not a person would emotionally connect with other people. In their report, the authors noted that these findings could be used for recommendation purposes and also as feedback to the presenters, in order to improve the quality of their public presentation. However, the usefulness of affective computing goes far beyond the way people present content. It may also transform the way they learn it.
Researchers from North Carolina State University explored the connection between students’ affective states and their ability to learn. Their software was able to accurately predict the effectiveness of online tutoring sessions by analyzing the facial expressions of participating students. The software tracked fine-grained facial movements such as eyebrow raising, eyelid tightening, and mouth dimpling to determine engagement, frustration, and learning. The authors concluded that “analysis of facial expressions has great potential for educational data mining.”
This type of technology is increasingly being used within the private sector. Affectiva is a Boston-based company that makes emotion recognition software. When asked to comment on this emerging technology, Gabi Zijderveld, chief marketing officer at Affectiva, explained in an interview for this article, “Our software measures facial expressions of emotion. So basically all you need is our software running and then access to a camera so you can basically record a face and analyze it. We can do that in real time or we can do this by looking at a video and then analyzing data and sending it back to folks.”
The technology has particular relevance for the advertising industry.
Zijderveld said, “We have products that allow you to measure how consumers or viewers respond to digital content…you could have a number of people looking at an ad, you measure their emotional response so you aggregate the data and it gives you insight into how well your content is performing. And then you can adapt and adjust accordingly.”
Zijderveld explained that this is the first market where the company got traction. However, they have since packaged up their core technology in software development kits or SDKs. This allows other companies to integrate emotion detection into whatever they are building.
By licensing its technology to others, Affectiva is now rapidly expanding into a wide variety of markets, including gaming, education, robotics, and healthcare. The core technology is also used in human resources for the purposes of video recruitment. The software analyzes the emotional responses of interviewees, and that data is factored into hiring decisions.
Richard Yonck is founder and president of Intelligent Future Consulting and the author of a book about our relationship with technology. “One area I discuss in Heart of the Machine is the idea of an emotional economy that will arise as an ecosystem of emotionally aware businesses, systems, and services are developed. This will rapidly expand into a multi-billion-dollar industry, leading to an infrastructure that will be both emotionally responsive and potentially exploitive at personal, commercial, and political levels,” said Yonck, in an interview for this article.
According to Yonck, these emotionally-aware systems will “better anticipate needs, improve efficiency, and reduce stress and misunderstandings.”
Affectiva is uniquely positioned to profit from this “emotional economy.” The company has already created the world’s largest emotion database. “We’ve analyzed a little bit over 4.7 million faces in 75 countries,” said Zijderveld. “This is data first and foremost, it’s data gathered with consent. So everyone has opted in to have their faces analyzed.”
The vastness of that database is essential for deep learning approaches. The software would be inaccurate if the data was inadequate. According to Zijderveld, “If you don’t have massive amounts of data of people of all ages, genders, and ethnicities, then your algorithms are going to be pretty biased.”
This massive database has already revealed cultural insights into how people express emotion. Zijderveld explained, “Obviously everyone knows that women are more expressive than men. But our data confirms that, but not only that, it can also show that women smile longer. They tend to smile more often. There’s also regional differences.”
Yonck believes that affective computing will inspire unimaginable forms of innovation and that change will happen at a fast pace.
He explained, “As businesses, software, systems, and services develop, they’ll support and make possible all sorts of other emotionally aware technologies that couldn’t previously exist. This leads to a spiral of increasingly sophisticated products, just as happened in the early days of computing.”
Those who are curious about affective technology will soon be able to interact with it.
Hubble Connected unveiled the Hubble Hugo at multiple trade shows this year. Hugo is billed as “the world’s first smart camera,” with emotion AI video analytics powered by Affectiva. The product can identify individuals, figure out how they’re feeling, receive voice commands, video monitor your home, and act as a photographer and videographer of events. Media can then be transmitted to the cloud. The company’s website describes Hugo as “a fun pal to have in the house.”
Although he sees the potential for improved efficiencies and expanding markets, Richard Yonck cautions that AI technology is not without its pitfalls.
“It’s critical that we understand we are headed into very unknown territory as we develop these systems, creating problems unlike any we’ve faced before,” said Yonck. “We should put our focus on ensuring AI develops in a way that represents our human values and ideals.”
Image Credit: Kisan / Shutterstock.com Continue reading

Posted in Human Robots