Sony Patents To Introduce Virtual Controller Buttons That Work With Finger Gestures

Expert Verified By

Sony Wants To Change Controllers Forever With The New System!

Story Highlight
  • Sony has published a new patent that will let gamers add and use virtual buttons with game controllers.
  • These virtual buttons will function using finger gestures, with multiple sensors detecting the gestures made by players during gameplay.
  • The patent also aims to introduce the feature for accessibility reasons to let an even broader audience enjoy PlayStation games.

Some gaming conglomerates have been engaged in an arms race to upgrade the console controller experience by securing patents. However, a new one, published by Sony, could change console gaming as we know it.

We’ve found a new Sony patent that wants to introduce the ability for gamers to create virtual buttons on existing controllers. These buttons will respond to finger gestures and do not require any physical changes to the layout.

Sony proposes using multiple sensors to detect finger gestures on controllers, allowing users to assign specific gestures to in-game tasks for enhanced immersion and accessibility.

The virtual-button can be identified on any surface of the controller where no real-buttons are disposed and the finger gesture on the virtual-button can be defined to be a single tap or a double tap or a press or a swipe in a particular direction, etc.

Why it matters: Sony is planning to make games even more convenient for PlayStation users by allowing them to create custom controls. This will let everyone finally surpass the limits currently set by the few physical buttons that exist on controllers.

The image illustrates a method for constructing an ensemble model to recognise gestures performed on a controller.

The patent discusses using data collected from sensors to detect gestures and perform the assigned input as if a virtual button were pressed

For example, a PlayStation user may pinch on the controller surface to perform a specific assigned combo or tap the back casing to alternate between fire modes in an FPS entry.

inputs for a video game provided by a user using a hand-held controller have to be properly identified and correctly interpreted in order to accurately affect a game state of the video game. Relying just on a single mode of data (e.g., image tracking a finger gesture) can lead to erroneous outcome in the video game.

The image shows a simplified flowchart for verifying an input provided to a controller.

Similarly, the user can also assign inputs to control other applications via the virtual buttons while engaging in gameplay, such as maintaining a music application simultaneously.

Users with disabilities could also use gestures to perform Morse code and have it translated to text or speech in a multiplayer game to communicate. Sony may even let disabled gamers play much of the game using virtual buttons alone.

Sony has also secured other unique patents over the years, including one that allows in-game NPCs to react to player emotions in real-time, and another for detecting chemicals in players’ sweat using controllers to monitor stress during gameplay.

Do you think having virtual buttons in controllers will make them feel more immersive? Let us know your thoughts in the comments below, or join the discussion on the Tech4Gamers forum.

Was our article helpful? 👨‍💻

Thank you! Please share your positive feedback. 🔋

How could we improve this post? Please Help us. 😔

Gear Up For Latest News

Get exclusive gaming & tech news before it drops. Sign up today!

Join Our Community

Still having issues? Join the Tech4Gamers Forum for expert help and community support!

Latest News

Join Our Community

104,000FansLike
32,122FollowersFollow

Trending

Roblox vs. Minecraft: Which Game Is Better For New Players?

When choosing between Roblox and Minecraft, factors like gameplay, creativity, and accessibility should be taken into account.

Going Below 40g With Mice: How Big Of A Difference Is It?

While light weight mouse are popular, ultra light weight mouse have also gained popularity. But are they any better than lighter ones?

You Can’t Rely On Your Computer’s Audio (You Need A DAC/AMP)

If you aren't already using a DAC/AMP setup, it is time you finally make the change. It is usually a one time investment that is much needed.

Why AMD’s Ryzen 5 9600X3D Could Be The Next Best Mid-Range Gaming CPU

AMD itself has leaked the Ryzen 5 9600X3D, the 6-core/12-thread successor to the 7600X3D but can it outgun the much cheaper Core i5-14600K?

From Silicon Forest To Silicon Graveyard: My Thoughts On Intel’s Mass Layoffs

Intel has announced yet another series of layoffs that may terminate up to 10,890 employees, so what’s Team Blue's game plan here?