×
You will be redirected back to your article in seconds

AI Ethics, Computer With Souls, Self-Playing Games

From Galatea to GLaDOS, our cultural fascination with not-quite-human consciousness and intelligence has spanned thousands of years. At PAX East on Saturday, Dr. Tyr Fothergill and Dr. Catherine Flick reflected on the place of AI in video games – both how it’s depicted in series like “Mass Effect” and how the technology is increasingly used within the industry in reality.

According to Flick, a scholar of computing and social responsibility at De Montfort University, the stories we tell about artificial intelligence in games reflect our values and attitudes toward AI as a whole. As she explained, “AI is usually viewed as operating within the context of human morality.” Eric Walpole, who wrote the character of GLaDOS from “Portal,” had one essential rule for her dialogue: She shouldn’t talk like a computer. While Flick describes GLaDOS as “notoriously evil,” those glimpses of something like humanity complicate our understanding of her role. She might, Flick suggests, simply be following her programming, prioritizing the perfection of the portal gun over her test subject.

Frank Lantz’s viral clicker game “Universal Paperclips” takes the same anxieties to a new extreme when an AI tasked with maximizing paperclip production determines that the most efficient way is to eliminate life on Earth. As Flick put it, “This is a lesson about the dangers of creating super-intelligent machines without programming protections for human existence into them, and the dangers presented by a lack of human values.”

In the “Mass Effect” franchise, the arc of the mechanoid species known as the Geth can also be taken as a cautionary tale. After recruiting Legion, a Geth unit who’s evolved beyond the constraints of his original programming and achieved self-awareness, the player must decide whether the rest of his race should be liberated at the cost of their “organic” oppressors.

For Fothergill, a research fellow with the Human Brain Project who specializes in human-nonhuman relationships, fictional beings like the Geth beg the question: “What is it to be human? Is it consciousness or, as Legion said, a soul?” According to one philosophy, known as “strong AI,” it’s simply a matter of information processing. If a computer can be programmed with the same inputs and outputs as a human brain, the argument goes, that computer has a mind in the same way we do.

This is a highly controversial take on consciousness – but regardless of how we define the mind, it’s clear that real-world AI is progressing rapidly. Google’s AlphaStar AI made headlines earlier this year when it defeated top-tier professional gamers in “StarCraft II,” a complex strategy game that demands both instantaneous decision-making and long-term tactics to succeed. Even when handicapped so that its reaction times were slower than its human competitors, AlphaStar dominated 10-1. Its accomplishments are a significant step up from those of IBM’s Deep Blue, which made history when it defeated reigning chess world champion Garry Kasparov in 1997. But some of the same questions still apply: the AI may be good at beating the game, but is it really playing it?

“AlphaStar doesn’t derive any fun, so far as we know,” said Flick. Nor would it be fun for the average human player to compete against – “especially the first ten times it kicks your arse.” Like other AI now learning to “play,” its understanding of the task it’s been assigned can lead to some baffling decisions by a human player’s standards. Fothergill described one case in which an AI was programmed to win a boat racing simulation – and did so by ignoring the race entirely, instead driving around in circles to rack up bonus points for stunts.

Sometimes, these imperfections are deliberate. When it comes to enemy NPCs, Flick noted, “We want fights to be challenging, but not frustratingly so. If [mob AI] were perfect – if it shot you in the head every time you stuck your head above the parapet – that wouldn’t be much fun.” And in the case of in-game allies, “We don’t want them to steal our glory by rushing up to the boss and killing them and taking all of the credit, so we probably have to dumb them down in terms of their accuracy and productivity.”

The goals and datasets these engines rely on are essential to the outcome – AlphaStar now has the equivalent of hundreds of years of experience with “Starcraft II,” but it was initially trained by “supervised learning” from real human matches. Increasingly, the game industry itself is learning from players, too. “Companies create profiles of your style of gameplay,” Fothergill explained. “The cutting edge of gaming AI is pointing toward a customized gameplay experience, particularly within role-playing games.” Data including the choices you make in an RPG, when you play, and even when you quit can be used for “more than you might expect… and may potentially be used against you if it ends up in the wrong hands.” As the panelists noted, player data from war games is already being used by the military to identify potential recruits.

Where artificial intelligence goes from here remains an open question. Fotherhill joked that we often model our AI on ourselves “because we’re really bad programmers” – and noted that being trained on human behavior means inheriting human biases, too.

Despite our fixation with simulating personhood, there are also aspects of the human experience we may never be able to convey. “How do you program a goal like ‘have dreams’ or ‘have a life’?” Fotherhill asked. In games and in reality, our creations are only as human – and humane – as the data we give them.

More Gaming

  • harry potter wizards unite

    'Harry Potter: Wizards Unite' Off to Slower Start Than 'Pokemon Go'

    Niantic’s new location-based augmented reality game “Harry Potter: Wizards Unite” is off to a solid start — but it doesn’t seem to have quite the same momentum as “Pokemon Go” did when it launched 3 years ago. That’s according to initial estimates from app analytics specialist Sensor Tower. “Harry Potter: Wizards Unite” first became available [...]

  • survios at the linq

    Not Just Gambling: Las Vegas Is Becoming a Virtual Reality Hub

    Walk into the Linq on the Las Vegas strip these days, and you might not immediately realize you just stepped into a casino. Instead, you’ll stumble across a series of living-room-like lounge setups, complete with leather couches, big-screen TVs, Xbox Ones and Oculus Go VR headsets. There’s also a bar with a massive wrap-around touch [...]

  • Netflix HQ LA

    Netflix Engineers Developed a Rumble Pack Feature During Latest Hack Day

    A duo of Netflix employees had a unique idea for making the service’s shows even more stirring: They added a rumble pack option to the Netflix app as part of the company’s latest hack day. When watching shows like “Voltron,” the feature makes phones vibrate in sync with the action on the screen, similar to [...]

  • Niantic's Harry Potter: Wizards Unite Game

    ‘Harry Potter: Wizards Unite’ to Launch This Week

    “Pokemon Go” maker Niantic is getting ready to launch its next big game: “Harry Potter: Wizards Unite” is set to launch in June 21, the company revealed in a tweet this week. The worldwide launch of Harry Potter: Wizards Unite begins this Friday, June 21! Keep your eyes peeled and wand ready for more information [...]

  • Sarah Iooss - Twitch

    Twitch Hires Sarah Iooss, Former Mic and Viacom Exec, as Head of North America Sales

    Twitch has tapped Sarah Iooss, most recently EVP of revenue at millennial-news startup Mic, to lead the advertising sales team in North America for the Amazon-owned live-streaming video platform focused on video gaming. Iooss will be based in New York, reporting to chief revenue officer Walker Jacobs, who joined Twitch last fall after serving as [...]

  • littlstar ps4 app

    Littlstar Expands Beyond VR With New PS4 App, Signs Up 30,000 Paying Subscribers (EXCLUSIVE)

    A&E-backed immersive content aggregator Littlstar is expanding beyond virtual reality (VR): The New York-based startup launched a dedicated PlayStation4 app this week, giving users of Sony’s game console access to their personal media libraries, as well as both traditional and 360-degree video content from a variety of publishers. Littlstar also announced that it signed up [...]

  • Game of Thrones Season 8 Production

    'Game of Thrones,' Netflix VFX Among Those to Be Featured in SIGGRAPH Production Talks

    VFX pros behind the final season of “Game of Thrones,” the blockbuster film “Avengers: Endgame,” Pixar’s upcoming “Toy Story 4,” last year’s Oscar-winning “Spider-Man: Into the Spider-Verse,” Netflix series, including “Stranger Things,” and more will give SIGGRAPH 2019 attendees a behind-the-scenes look at their work during the conference’s Production Sessions. There will even be a [...]

More From Our Brands

Access exclusive content