In a new company report, Sony says that to speed up game development on the PlayStation, it will make greater use of AI and machine learning.
According to the Insider Gaming website, Sony notes on page 16 of the report that the use of artificial intelligence will cover many aspects of game development. This includes “detection and capture, as well as real-time 3D processing of” games. The company says artificial intelligence will allow it to deliver games “to a wider range of fans quickly and at low cost.”
The report says Sony used machine learning to create Marvel’s Spider-Man 2, including using voice recognition software in certain languages. This process allowed the company to automatically sync subtitles with each character’s lines to “significantly reduce the captioning process.” Sony also revealed that it is creating the Volumetric Capture Studio, which will generate 3D data of people and places for reproduction in “high-quality images”.
“Going forward, we plan to leverage high-quality 3D sources, including motion data from our studio, collected by each of our companies within the Group, and will explore potential external sales.”
«Regarding real-time 3D processing, we are conducting research with Epic Games, focusing on the Unreal Engine, which is designed as a physics engine for generating computer graphics in games. For example, we reused 3DCG components from a music video shot using virtual production to create a game set in the same world and produced a CG-based proof of concept short film using Unreal Engine.
Artificial intelligence and machine learning in games have sparked a heated debate about fair pay and actors’ rights. It seems that other representatives of the gaming industry should also be concerned.