A prototype video has emerged appearing to show PlayStation character Aloy, from the Horizon games, interacting with player characters via AI-generated animations, writing and voice.
The video, which has since been removed due to a copyright claim, was narrated by Sharwin Raghoebardajal, a director of software engineering at Sony Entertainment.
In the footage, Raghoebardajal states that the technology was developed in conjunction with Guerilla Games as an internal Sony presentation.
It is powered by OpenAI’s whisper for speech-to-text, GPT-4 and Llama 3 for conversation, and Sony’s own Emotional Voice Synthesis for speech generation.
SAG-AFTRA is on a conditional strike over AI protections in voice acting, including voice replacements, and the utility of endless AI-driven conversations with game characters has been called into question.
It is speculated that Sony may have further designs on the application of this technology.