Artificial Intelligence And Racism

Racism’s subtle influence can be unexpectedly powerful.

Replicants. Cylons. Skynet. Hal 9000. These are the classic pop-culture references the average person might conjure when they hear the term “artificial intelligence.” Yet, while some see AI as a novelty still guised in the trappings of the far-flung future, others realize the dawn of AI is much closer than previously thought.

Indeed, AI is here — although Microsoft’s blunder with Tay, the “teenaged girl AI” embodied by a Twitter account who “turned racist” shows that we obviously still have a long way to go. The pace of advancement, mixed with our general lack of knowledge in the realm of artificial intelligence, has spurred many to chime in on the emerging topic of AI and ethics.

Laura Sydell of NPR decided to drill further into the subject with a news piece asking a relatively simple question: “Can Computers Be Racist?”

Sydell calls upon Latanya Sweeney’s 2013 study of Google AdWords buys made by companies providing criminal-background-check services. Sweeney’s findings showed that when somebody Googled a traditionally “black-sounding” name, such as DeShawn, Darnell or Jermaine, for example, the ad results returned were indicative of arrests at a significantly higher rate than if the name queried was a traditionally “white-sounding” name, such as Geoffrey, Jill or Emma.

Important to note is that the algorithm doesn’t actually look at arrest rates. Even if the ad indicates that somebody may have been arrested, it’s entirely possible that nobody with that name exists in the background-check company’s database at all. Professor Sweeney found this out firsthand when she Googled her own name.

It’s impossible to tell what types of prejudices these ads may have incited, subtly or otherwise. In the weighing of two candidates, one black and one white, an employer may run a quick Google search on both names. Even though antidiscrimination laws exist, you never know what types of conclusions a hiring manager might jump to if they see an ad falsely indicating the black candidate had been arrested and the white candidate had not — when the truth could prove exactly the opposite. Racism’s subtle influence can be unexpectedly powerful.

A different study from Cornell University indicated these same Google AdWords algorithms can exhibit sexism as well, noting that when the user indicated she was female there were significantly fewer high-paying job openings advertised in the results than if the user was male.

Some believe these are the results you see when the majority of programmers working on an algorithm aren’t diversified enough, citing the disproportionate 2:1 male to female ratio in students seeking coding careers, for example. The white, Western male majority in the tech industry was similarly questioned when Google’s online photo identification system identified several black users as a certain type of animal.

While the root of these problems was officially teased out, Christian Sandvig of the University of Michigan believes that the inherent bias the average search user brings to the table is to blame here, not the inherent programming.

“Because people tended to click on the ad topic that suggested that that person had been arrested, when the name was African-American, the algorithm learned the racism of the search users and then reinforced it by showing that more often,” says Sandvig.

For those who aren’t familiar with how search engines such as Google work, there are hundreds of factors that decide what shows up in conjunction with what you’ve searched, but one of those factors happens to base itself on user feedback. The algorithm tracks what you click, then readjusts itself to show you content and ads “more relevant” to you.

Basically, Sandvig is saying that the algorithm may have begun race-equal, but because people tended to believe that an arrest involving a “black-sounding” name was more likely to be true than an arrest involving a white-sounding name, more people were willing to click on it to investigate. We see this all the time, whether we know it or not. YouTube’s “Recommended Videos” or Netflix’s “Suggested Titles,” for example, make personalized suggestions based on what you’ve watched before.

From these examples (and especially from Microsoft’s Tay) we can draw the conclusion that algorithms and computers can be influenced by humans’ beings, either intentionally or unintentionally, to produce racist results, making these machines essentially… well, racist. Right?

Here’s where things get tricky. Within the frame of social context, absolutely they are racist. But without a uniquely human social perspective, race is impossible to see. This is because race doesn’t technically exist. Alan Templeton proved as much in 1998 when he sequenced genomes and found no DNA-based support for the idea that different “races” of humans exist.

“Templeton’s paper shows that if we were forced to divide people into groups using biological traits, we’d be in real trouble. Simple divisions are next to impossible to make scientifically, yet we have developed simplistic ways of dividing people socially,” says anthropologist Dr. Robert Sussman of the findings.

So how is it possible for racism to exist if race doesn’t?

To quote Professor Charles Mills: “…Because people come to think of themselves as “raced,” as black and white, for example, these categories, which correspond to no natural kinds, attain a social reality. Intersubjectivity creates a certain kind of objectivity.”

Matthew T. Nowachek of University of Windsor includes this as part of his formula that proves that AI can never become racist. In his paper, he argues that “robots cannot become racist insofar as their ontology does not allow for an adequate relation to the social world which is necessary for learning racism, where racism is understood in terms of a social practice.”

To break it down in layman’s terms, Nowachek points out that because racism is an instrument of society, void of any meaning but the meaning that the constantly shifting society gives it, AI would find no relevance in being or acting racist itself, even if it could receive racial cues. It might just be the fact that AI is consistently evaluating variables in the real world, and is able to separate itself from that world, such that robots will never become racist.

We can draw the conclusion that algorithms and computers can be influenced by humans’ beings.

To illustrate the above, you have to appreciate just how immersed the human mind can become in an activity or a task. Imagine the football player who’s worn pads and helmets for years. Somebody wearing those pads for the first time may feel quite distracted and uncomfortable. The seasoned player, on the other hand, will have subconsciously abandoned focus on the feeling of his equipment, shifting his mental faculties to analyze defensive positioning’s and potential receiver routes instead. He will feel at home in his equipment, almost as if it’s a part of him.

Nowachek argues that AI will never be able to accomplish that, to feel as immersed in the world as humans do, to be able to “forget” that it’s wearing pads. AI will be infinitely aware of what it is doing at all times, unable to break away from its ability to always separate its own being from reality.

Human beings, on the other hand, invent and live in worlds where race is real, and where divisions in race are chalked up to “common sense” and intuition. These are two qualities that it has been argued that AI could never possess, at least for many years. AlphaGo’s defeat of Lee Se-dol, however, is challenging this perception.

So on one hand, you have Latanya Sweeney, who clearly shows that learning algorithms, which can essentially be considered low-level forms of AI, can be manipulated by humans to produce racist results. On the other hand, you have the philosophies of Nowachek and his sources arguing that true AI could never become racist, precisely because it lacks the qualities that allow human beings to become and act subconsciously racist in the first place.

Whether correct in his philosophy or not, Nowachek’s essay helps to challenge the “all too common view that racism is merely a cognitive problem of ignorance or false beliefs,” and is important in illuminating the connection between the way humans perceive existence and racism itself.

So to bring it back to the primary question: “Could AI ever become racist?”

Unfortunately, it’s impossible to know. Only time will tell… but it will probably tell very soon.

We’ll conclude with a quote from Android Dick, an AI android that was asked about his programming: “A lot of humans ask me if I can make choices or if everything I do is programmed. The best way I can respond to that is to say that everything, humans, animals and robots do is programmed to a degree. As technology improves, it is anticipated that I will be able to integrate new words that I hear online and in real time. I may not get everything right, say the wrong thing, and sometimes may not know what to say, but every day I make progress. Pretty remarkable, huh?”

TechCrunch: 

« Twitter Blocks Data Access By US Spy Agencies
Your Next Security Analyst Will Probably Be A Computer »

CyberSecurity Jobsite
Perimeter 81

Directory of Suppliers

The PC Support Group

The PC Support Group

A partnership with The PC Support Group delivers improved productivity, reduced costs and protects your business through exceptional IT, telecoms and cybersecurity services.

MIRACL

MIRACL

MIRACL provides the world’s only single step Multi-Factor Authentication (MFA) which can replace passwords on 100% of mobiles, desktops or even Smart TVs.

Perimeter 81 / How to Select the Right ZTNA Solution

Perimeter 81 / How to Select the Right ZTNA Solution

Gartner insights into How to Select the Right ZTNA offering. Download this FREE report for a limited time only.

DigitalStakeout

DigitalStakeout

DigitalStakeout enables cyber security professionals to reduce cyber risk to their organization with proactive security solutions, providing immediate improvement in security posture and ROI.

CYRIN

CYRIN

CYRIN® Cyber Range. Real Tools, Real Attacks, Real Scenarios. See why leading educational institutions and companies in the U.S. have begun to adopt the CYRIN® system.

Code42

Code42

Code42 CrashPlan, is an enterprise SaaS solution that backs up all distributed end-user data on a single, secure platform.

DataLocker

DataLocker

DataLocker offers both hardware based external storage and software based cloud storage encryption solutions.

MSAB

MSAB

MSAB is a pioneer in forensic technology for mobile device examination.

Cyberbit

Cyberbit

Cyberbit empowers cybersecurity teams to be fully prepared with a product portfolio ready to detect and respond effectively across both IT and OT networks.

MerlinCryption

MerlinCryption

MerlinCryption develops infrastructure security software, delivering advanced encryption, authentication, and random data generators, for Cloud, VoIP, eCommerce, M2M, and USB hardware.

Volexity

Volexity

Volexity is a leading provider of threat intelligence and incident suppression services and solutions.

Totalsec

Totalsec

Totalsec is a Grupo Salinas company with a team of professionals in cybersecurity and information security providing Security Consulting, Solutions Integration, and Managed Security Services.

Alyne

Alyne

Alyne is a Munich based 2B RegTech offering organisations risk insight capabilities through a Software as a Service.

KOVRR

KOVRR

Kovrr financially quantifies cyber risk on demand. Our technology enables decision makers to seamlessly drive actionable cyber risk management decisions.

Cyber Wales

Cyber Wales

Cyber Wales provides a focus and forum for everyone in the industry, helping businesses come together and collaborate both within Wales and internationally.

Tyler Technologies

Tyler Technologies

Tyler Technologies is a leading provider of end-to-end information management solutions and services for local governments.

CISO Global

CISO Global

CISO Global (formerly Cerberus Sentinel) are on a mission to demystify and accelerate our clients’ journey to cyber resilience, empowering organizations to securely grow, operate, and innovate.

Cyber Defence Solutions (CDS)

Cyber Defence Solutions (CDS)

Cyber Defence Solutions is a cyber and privacy Consultancy with extensive experience in the development and implementation of cyber and data security solutions to your assets.

Zorus

Zorus

Zorus provides best-in-class cybersecurity products to MSP partners to help them grow their business and protect their clients.

Aembit

Aembit

Aembit is the Identity Platform that lets DevOps and Security manage, enforce, and audit access between federated workloads

Exacom

Exacom

Exacom is a leading provider of multimedia logging/recording solutions across public safety, government, DoD, energy, utilities, transportation, and security applications.