Sony's New AI Patent Predicts Button Presses via Finger-Camera Tech

Sony has recently filed a new patent, WO2025010132, titled "TIMED INPUT/ACTION RELEASE," which aims to reduce latency in future gaming hardware. This innovative approach involves using an AI model combined with additional sensors to predict and streamline user commands, enhancing the responsiveness of gameplay.

With the introduction of PlayStation Spectral Super Resolution (PSSR) on the PlayStation 5 Pro, Sony has shown its commitment to improving visual quality by upscaling resolutions to 4K. However, technologies like frame generation, while beneficial for frame rates, can introduce latency, making games feel less responsive. This issue is not unique to Sony, as GPU manufacturers AMD and Nvidia have introduced Radeon Anti-Lag and Nvidia Reflex to address similar concerns.

This new Sony patent could revolutionize the gaming experience on PlayStation. Image credit: Sony Interactive Entertainment.

According to Tech4gamers, Sony's patent outlines a system that predicts the next button press using a machine-learning AI model and external sensors. For instance, a camera could be used to monitor the controller and anticipate the user's next move. The patent states, "In one particular example, the method may include providing camera input as an input to a machine learning (ML) model. The camera input may indicate the first user command."

Another intriguing possibility mentioned is the use of controller buttons as sensors. Given Sony's history with analog buttons, this could be a feature in a next-generation controller, further enhancing the system's ability to predict and execute commands with minimal latency.

While it's uncertain whether this exact technology will be implemented in the PlayStation 6, Sony's exploration of these methods underscores their dedication to improving gaming performance. With technologies like FSR 3 and DLSS 3 adding frame latency, Sony's approach could significantly benefit genres like twitch shooters, where both high frame rates and low latency are crucial.

Whether this patent will translate into actual hardware improvements remains to be seen, but it's clear that Sony is actively working to ensure that future PlayStation consoles deliver a seamless and responsive gaming experience.