Sony Patents To Let In-Game NPCs React To Player Emotions In Real-Time

Expert Verified By

NPCs May Become Even More Immersive!

Story Highlight
  • Sony has published a new patent that aims to enable in-game assets, such as NPCs, to react to players’ emotions in real-time.
  • The patent proposes NPCs using real-world player sounds to detect mood and respond accordingly.
  • For example, NPCs in games may cheer up and sound happy if they detect the player laughing and clapping in real life, and vice versa.

Besides pushing for better accessibility, Sony has also been securing patents to improve immersion for players in games. We have discovered a new patent that aims to make NPCs more reactive and dynamic, allowing each player to experience the game uniquely.

The patent describes in-game assets like NPCs reacting to players’ real-time emotions by analyzing real-world sounds to assess mood and respond accordingly. For example, players clapping or whistling may also cause the NPCs to celebrate in response.

Similarly, a player speaking aggressively may cause the NPCs to become more defensive and cautious in their interactions with them.

 One or more of the audio input parameters are used as audio synchronization control to control at least some movements and/or interactions between at least the two assets that are present in the one or more game scenes of the game. The at least two assets may be NPCs.

Why it matters: Sony aims to enhance the NPCs in games to make them more immersive, thereby affecting gameplay for every player differently, rather than adhering to a single set of parameters.

The figure shows a method of providing audio synchronization control in game scenes of a game.

The patent discusses a system that listens for speech, ambient sounds, or music using the player’s microphones using AI. Once the player’s mood is determined, the game adjusts NPC interactions based on that analysis.

Sony argues that games currently provide a limited experience because NPC reactions are only based on standard game logic. This system enables games to deliver a more personalized experience by harnessing players’ emotions.

During play of the video game, if the user wishes to customize reaction of any game asset, the user is unable to provide such customization as the reactions of the game assets is controlled by game logic of the video game.

The figure illustrates various sources of audio data suitable for providing audio synchronization control of at least two NPCs.

Sony also mentions that the system supports multiplayer settings, allowing NPCs to be influenced by group reactions. Additionally, spectators can impact gameplay by influencing NPCs with collective cheering or chanting.

Sony has also published a variety of other notable patents over the decades, including one for detecting chemicals in players’ sweat using controllers to monitor stress during gameplay and another one for expediting the development of AI-powered game remasters.

Do you think that NPCs reacting to the real-life emotions of players dynamically will improve the immersion of games? Let us know your thoughts in the comments below, or join the discussion on the Tech4Gamers forum.

Was our article helpful? 👨‍💻

Thank you! Please share your positive feedback. 🔋

How could we improve this post? Please Help us. 😔

Gear Up For Latest News

Get exclusive gaming & tech news before it drops. Sign up today!

Join Our Community

Still having issues? Join the Tech4Gamers Forum for expert help and community support!

Latest News

Join Our Community

104,000FansLike
32,122FollowersFollow

Trending

NVIDIA’s RTX 50-Series Fiasco Has Made Gaming Laptops The Only Sensible Buy

The RTX 50 Series GPUs are going up in prices every single day and they aren’t coming down anytime soon. The solution? A gaming laptop.

Roblox vs. Minecraft: Which Game Is Better For New Players?

When choosing between Roblox and Minecraft, factors like gameplay, creativity, and accessibility should be taken into account.

Sony Patents To Introduce Virtual Controller Buttons That Work With Finger Gestures

A new patent published by Sony discusses bringing the ability for controllers to have virtual buttons that work with users' finger gestures.

Going Below 40g With Mice: How Big Of A Difference Is It?

While light weight mouse are popular, ultra light weight mouse have also gained popularity. But are they any better than lighter ones?

You Can’t Rely On Your Computer’s Audio (You Need A DAC/AMP)

If you aren't already using a DAC/AMP setup, it is time you finally make the change. It is usually a one time investment that is much needed.