Leaked Internal Sony Video Uses Horizon's Aloy to Show AI-Powered PlayStation Character Prototype

A leaked internal video reveals Sony's experimentation with AI-powered PlayStation characters. The Verge reported on a PlayStation Studios' advanced technology group video showcasing AI-powered Aloy from the *Horizon* games. The video, subsequently removed from YouTube due to a copyright claim from Muso (a company listing Sony Interactive Entertainment as a client), features Sony Interactive Entertainment director of software engineering, Sharwin Raghoebardajal, conversing with an AI Aloy. This suggests the video's authenticity.

The AI uses OpenAI's Whisper for speech-to-text, GPT-4 and Llama 3 for dialogue and decision-making, Sony's Emotional Voice Synthesis (EVS) for speech, and Sony's Mockingbird technology for facial animation. While the conversation demonstrates impressive technological capabilities, the AI Aloy's robotic voice (not Ashly Burch's) and stiff facial animations are noticeable. The conversation touches upon Aloy's identity as a clone of Dr. Elizabeth Sobeck and her feelings about it.

The demo transitions into *Horizon Forbidden West*, with Raghoebardajal continuing the conversation within the game world. This juxtaposition highlights the technology's potential and limitations. The project, a prototype developed with Guerrilla Games, showcases Sony's investment in AI, though no public-facing applications have been announced.

Sony's exploration of AI-powered characters aligns with industry trends. Microsoft's AI, Muse, generates game design ideas, while EA and Capcom are also exploring generative AI for various game development aspects. Keywords Studios' unsuccessful attempt to create an entirely AI-driven game underscores the limitations of current AI technology in replacing human talent. The use of AI in games is seen as crucial for appealing to younger generations seeking personalized gaming experiences, as highlighted by Asad Qizilbash of PlayStation Productions and PlayStation Studios.

Recent controversies surrounding AI-generated assets in games, such as Activision's use of AI for some *Call of Duty: Black Ops 6* assets, highlight the ongoing ethical and practical challenges surrounding AI in game development.

What's The Best PlayStation 5 Game?

Pick a winner