Sony's New AI Patent Predicts Button Presses via Finger Camera

Sony's latest patent filing, WO2025010132, titled "TIMED INPUT/ACTION RELEASE," aims to revolutionize the gaming experience by minimizing latency in future PlayStation hardware. The introduction of PlayStation Spectral Super Resolution (PSSR) with the PlayStation 5 Pro marked a significant step in upscaling technology, but it also highlighted the challenge of latency, particularly when using frame generation techniques. This new patent suggests Sony is actively seeking solutions to ensure games remain responsive despite technological advancements.

This new Sony patent could be a game-changer for PlayStation. Image credit: Sony Interactive Entertainment.

The patent, first noticed by Tech4gamers, proposes a system that uses a machine-learning AI model to predict a player's next input. This predictive model would be supported by additional sensors, such as a camera focused on the controller to anticipate button presses. Sony's filing explains that "there can be latency between the user's input action and the system's subsequent processing and execution of the command," leading to delayed execution and potential gameplay issues.

The method described in the patent involves feeding camera input into the machine learning model to identify the first user command. Another innovative approach mentioned is the use of the controller's buttons as sensors, which aligns with Sony's history of embracing analog inputs.

Although the exact implementation of this technology in devices like the PlayStation 6 remains uncertain, the patent underscores Sony's commitment to reducing latency. This is particularly relevant in the context of popular rendering technologies like FSR 3 and DLSS 3, which can introduce additional frame latency. The potential application of this technology in real-time scenarios, such as twitch shooters that demand high framerates and low latency, could significantly enhance the gaming experience.

Whether or not this patent will be integrated into future hardware is yet to be determined, but it clearly signals Sony's proactive approach to tackling latency issues in gaming.