Will AI make gaming more immersive or just weird?

Author

Matt V
March 12, 2025

GAMING

Sony is testing an AI-powered version of at least one PlayStation character, with an internal demo showing a prototype of Aloy from Horizon Forbidden West.

A leaked video shared with The Verge displayed Aloy responding to voice prompts with AI-generated speech and facial movements.

Sony later removed the video due to a copyright claim.

The AI system combines OpenAI’s Whisper for speech-to-text, GPT-4 and Llama 3 for conversations, and Sony’s in-house voice synthesis and facial animation tools.

While the demo ran on a PC, Sony also tested parts of the PS5 technology with minimal impact on performance.

In brief:

  • Sony is developing AI-powered game characters, with Aloy from Horizon Forbidden West shown in a prototype.

  • The AI uses OpenAI models and Sony’s proprietary speech and facial animation technology.

  • Nvidia and Microsoft are also exploring AI-driven game development, sparking industry concerns about its impact on jobs and creativity.

What if your game characters had opinions?

Sony trialled this AI model a year ago and later showcased an improved version at its Sony Technology Exchange Fair in November.

However, it remains a prototype, and it’s unclear if it will be used in future games.

Other major companies are also working on AI-powered game characters.

Nvidia’s ACE technology allows real-time conversations with NPCs, while Microsoft is partnering with Inworld AI to bring AI-driven characters and storylines to Xbox.

Microsoft has also developed Muse AI, which helps create game environments.

AI’s growing presence in gaming has raised concerns, especially as job cuts impact the industry.

A Game Developers Conference (GDC) survey found that 49% of developers already use generative AI in their workplaces, with 31% using it personally.

With GDC 2024 coming up, debates about AI’s role in game development will likely grow. Sony has not responded to questions about the leaked video or its removal.

Imagine AI Aloy ripping into you for not being good at the game.