Sony Unveils AI-Powered Aloy Prototype in Leaked Video

A leaked internal video has revealed that Sony is delving into the realm of AI-powered PlayStation characters, showcasing a fascinating glimpse into the future of gaming. The Verge reported on a video created by PlayStation Studios' advanced technology group, featuring Aloy from the Horizon series to demonstrate the potential of AI in enhancing game character interactions.

The video, which was briefly available on YouTube before being removed due to a copyright claim by Muso—an enforcement company linked to Sony Interactive Entertainment—illustrates the use of cutting-edge technologies. Sony Interactive Entertainment's director of software engineering, Sharwin Raghoebardajal, engages in a conversation with an AI-driven Aloy, utilizing voice prompts and AI-generated speech and facial animations.

The technological backbone of this demo includes OpenAI's Whisper for speech-to-text conversion, conversational AI powered by GPT-4 and Llama 3, Sony's Emotional Voice Synthesis (EVS) system for speech synthesis, and Sony's Mockingbird technology for facial animations. This combination allows for a dynamic interaction, albeit with a robotic voice and somewhat stiff facial movements.

In the demo, Aloy responds to inquiries about her well-being and her search for her mother, revealing her identity as a clone of Dr. Elizabeth Sobeck and discussing her unique perspective on life. The conversation transitions seamlessly into the Horizon Forbidden West game world, where Raghoebardajal continues to interact with Aloy, highlighting the potential integration of such technology into gameplay.

While this demo represents a prototype developed in collaboration with Horizon's studio, Guerrilla Games, it underscores Sony's commitment to exploring AI's possibilities within gaming. Sharwin Raghoebardajal emphasizes that this is just a glimpse of what could be possible, though Sony has yet to confirm any plans to incorporate this technology into public-facing PlayStation products.

Sony's exploration of AI is not isolated; competitors like Microsoft are also heavily investing in AI technologies, with Microsoft recently unveiling an AI called Muse aimed at generating game design ideas. The broader video game and entertainment industries are grappling with generative AI, amidst ethical and rights concerns, and varying degrees of success in creating engaging content.

Recent statements from industry leaders like EA and Capcom highlight the growing importance of AI in game development, with EA describing AI as "the very core" of its business and Capcom experimenting with AI to generate vast quantities of in-game ideas. Asad Qizilbash, head of PlayStation Productions and head of product at PlayStation Studios, emphasized the significance of AI in personalizing gaming experiences for younger generations who value customization and meaningful interactions.

The use of generative AI has sparked debates, with examples like Activision's use of AI in Call of Duty: Black Ops 6 and Keywords Studios' unsuccessful attempt to create an entirely AI-generated game illustrating the challenges and criticisms faced by the technology in the gaming world.