×
You will be redirected back to your article in seconds

‘Speaking Simulator’ and the Fine Art of Talking

Most of us rarely consider just how difficult it would be to learn how to speak from scratch. But that’s the mission of one very odd upcoming game.

Affable Games, a two-person team out of Brisbane, Australia, is currently developing “Speaking Simulator,” and they brought a demo of it to the Game Developers Conference. Sure, the idea of the game is mostly contained in the name. However, what it doesn’t tell you is that you play as a newly-created, and completely clueless, android who must learn quickly how to blend in to the rest of society to achieve total domination.

But before you can take over humanity, you have to learn how to speak.

In the game, you control both the mouth’s movements and the tongue’s position to imitate the physiology of how speech is created. You do this through a variety of escalating challenges, like managing employees, socializing at a club and giving a eulogy at a funeral.

Affable Games co-founder Jed Dawson said that inspiration for creating “Speaking Simulator” came from his time lecturing students. Dawson said he was teaching facial animation and his students would deform and manipulate the physics of the human mouth “to the point where they destroyed it.”

It made him realize “how we take for granted our bodily mechanics,” and led to the creation of the purposefully-awkward game. The developers researched all of the mechanics involved with speech including inflection, intonation, control of the voice box, all to learn the best way to simulate what it take to make the words we use every day.

Dawson also admitted that his frustration with “The Dark Knight” film was a large, albeit unexpected, inspiration for the game. He was particularly bothered by Harvey Dent’s face melting off.

“It really annoyed me that he could still talk perfectly,” Dawson said. “This game is my attack on Christopher Nolan.”

Affable Games’ Co-founder Jordan Comino had a much simpler inspiration for wanting to create “Speaking Simulator.”

“I just like robots,” he said.

“QWOP,” a simple, yet maddeningly-difficult game where players control only the calves and the thighs of a runner with the Q,W,O and P keys on a keyboard, is actually a very good analogy of what it feels like to play “Speaking Simulator.”

After a very brief tutorial, the demo that I played put me on a date as I attempted to navigate both the shape of my character’s mouth and the position of the tongue to try and form words. You are given a front view of the face to drag the mouth around with the mouse. And simultaneously, there is a side view of the inside of the mouth, complete with a tongue and buttons along the oral cavity. You control a stretchy, slimy tongue with the W, A, S and D keys.

As the player, you are tasked with shaping the mouth and placing the tongue on the corresponding button to craft the sounds of words in a certain amount of time. Otherwise, the people to whom you’re “speaking” might get suspicious.

The scene devolves into extreme silliness as the android’s human face deforms during the level. Its teeth fall out, its face sparks, its eyes bulge, all while your date remains oblivious to the what’s going on in front of them.

Another game that the creators credited with inspiring “Speaking Simulator” is 2010’s “Octodad” and the 2014 sequel “Octodad: Dadliest Catch.” In these games you control the limbs of an unsteady octopus, trying to act like a normal father without raising the suspicions of those around.

“Speaking Simulator” has a very similar suspicion bar that keeps track of how well, or how long, it takes you to create simple sounds.

“It’s really hard to make a game that’s new,” Dawson said about the unique mechanics involved with “Speaking Simulator.” While there are plenty of games built around running, jumping or shooting that a developer could learn from, the number of games built around moving lips and tongue is slim to none.

That made it also difficult to tell how to make the game enjoyable. They said they struggled with the question of how realistic to make the speech simulation.

“We’re somewhere around the 10th iteration of how to make the mouth shapes,” Comino said. “The first iteration was almost a perfect representation. But that’s not fun.”

I only played the first level, though the creators explained how the difficulty and complexity of the game increased over time as new elements were added. Smiling, frowning, eye movement, and more all become part of the conversations your android must face to achieve its goals of domination.

Dawson and Comino said that perhaps most interesting about the reception of the game so far has been the reaction from people who have difficulty reading social cues or are on the autism spectrum. They said they have been contacted by the Art for Autism nonprofit and will be demoing the game for them during GDC.

“A lot of people find it very comforting,” Dawson said about playing an android struggling to appear “normal.” He was excited to share the game with Art for Autism. “They’re super interested in it.”

Affable Games carries with it something of a mobile pedigree; both Comino and Dawson worked for Halfbrick Studios, which is responsible for the hit game “Fruit Ninja.” That’s why their first title as a new studio, “Astro Crash” a twitchy shooter released in 2017, was a mobile game. “Speaking Simulator” is the full PC title from Affable Games.

The developers expect to release “Speaking Simulator” in the third quarter of this year first on Steam and then they said that they might possibly bring it to consoles.

More Gaming

  • harry potter wizards unite

    'Harry Potter: Wizards Unite' Off to Slower Start Than 'Pokemon Go'

    Niantic’s new location-based augmented reality game “Harry Potter: Wizards Unite” is off to a solid start — but it doesn’t seem to have quite the same momentum as “Pokemon Go” did when it launched 3 years ago. That’s according to initial estimates from app analytics specialist Sensor Tower. “Harry Potter: Wizards Unite” first became available [...]

  • survios at the linq

    Not Just Gambling: Las Vegas Is Becoming a Virtual Reality Hub

    Walk into the Linq on the Las Vegas strip these days, and you might not immediately realize you just stepped into a casino. Instead, you’ll stumble across a series of living-room-like lounge setups, complete with leather couches, big-screen TVs, Xbox Ones and Oculus Go VR headsets. There’s also a bar with a massive wrap-around touch [...]

  • Netflix HQ LA

    Netflix Engineers Developed a Rumble Pack Feature During Latest Hack Day

    A duo of Netflix employees had a unique idea for making the service’s shows even more stirring: They added a rumble pack option to the Netflix app as part of the company’s latest hack day. When watching shows like “Voltron,” the feature makes phones vibrate in sync with the action on the screen, similar to [...]

  • Niantic's Harry Potter: Wizards Unite Game

    ‘Harry Potter: Wizards Unite’ to Launch This Week

    “Pokemon Go” maker Niantic is getting ready to launch its next big game: “Harry Potter: Wizards Unite” is set to launch in June 21, the company revealed in a tweet this week. The worldwide launch of Harry Potter: Wizards Unite begins this Friday, June 21! Keep your eyes peeled and wand ready for more information [...]

  • Sarah Iooss - Twitch

    Twitch Hires Sarah Iooss, Former Mic and Viacom Exec, as Head of North America Sales

    Twitch has tapped Sarah Iooss, most recently EVP of revenue at millennial-news startup Mic, to lead the advertising sales team in North America for the Amazon-owned live-streaming video platform focused on video gaming. Iooss will be based in New York, reporting to chief revenue officer Walker Jacobs, who joined Twitch last fall after serving as [...]

  • littlstar ps4 app

    Littlstar Expands Beyond VR With New PS4 App, Signs Up 30,000 Paying Subscribers (EXCLUSIVE)

    A&E-backed immersive content aggregator Littlstar is expanding beyond virtual reality (VR): The New York-based startup launched a dedicated PlayStation4 app this week, giving users of Sony’s game console access to their personal media libraries, as well as both traditional and 360-degree video content from a variety of publishers. Littlstar also announced that it signed up [...]

  • Game of Thrones Season 8 Production

    'Game of Thrones,' Netflix VFX Among Those to Be Featured in SIGGRAPH Production Talks

    VFX pros behind the final season of “Game of Thrones,” the blockbuster film “Avengers: Endgame,” Pixar’s upcoming “Toy Story 4,” last year’s Oscar-winning “Spider-Man: Into the Spider-Verse,” Netflix series, including “Stranger Things,” and more will give SIGGRAPH 2019 attendees a behind-the-scenes look at their work during the conference’s Production Sessions. There will even be a [...]

More From Our Brands

Access exclusive content