Sony Patents To Let In-Game NPCs React To Player Emotions In Real-Time

Expert Verified By

NPCs May Become Even More Immersive!

Story Highlight
  • Sony has published a new patent that aims to enable in-game assets, such as NPCs, to react to players’ emotions in real-time.
  • The patent proposes NPCs using real-world player sounds to detect mood and respond accordingly.
  • For example, NPCs in games may cheer up and sound happy if they detect the player laughing and clapping in real life, and vice versa.

Besides pushing for better accessibility, Sony has also been securing patents to improve immersion for players in games. We have discovered a new patent that aims to make NPCs more reactive and dynamic, allowing each player to experience the game uniquely.

The patent describes in-game assets like NPCs reacting to players’ real-time emotions by analyzing real-world sounds to assess mood and respond accordingly. For example, players clapping or whistling may also cause the NPCs to celebrate in response.

Similarly, a player speaking aggressively may cause the NPCs to become more defensive and cautious in their interactions with them.

 One or more of the audio input parameters are used as audio synchronization control to control at least some movements and/or interactions between at least the two assets that are present in the one or more game scenes of the game. The at least two assets may be NPCs.

Why it matters: Sony aims to enhance the NPCs in games to make them more immersive, thereby affecting gameplay for every player differently, rather than adhering to a single set of parameters.

The figure shows a method of providing audio synchronization control in game scenes of a game.

The patent discusses a system that listens for speech, ambient sounds, or music using the player’s microphones using AI. Once the player’s mood is determined, the game adjusts NPC interactions based on that analysis.

Sony argues that games currently provide a limited experience because NPC reactions are only based on standard game logic. This system enables games to deliver a more personalized experience by harnessing players’ emotions.

During play of the video game, if the user wishes to customize reaction of any game asset, the user is unable to provide such customization as the reactions of the game assets is controlled by game logic of the video game.

The figure illustrates various sources of audio data suitable for providing audio synchronization control of at least two NPCs.

Sony also mentions that the system supports multiplayer settings, allowing NPCs to be influenced by group reactions. Additionally, spectators can impact gameplay by influencing NPCs with collective cheering or chanting.

Sony has also published a variety of other notable patents over the decades, including one for detecting chemicals in players’ sweat using controllers to monitor stress during gameplay and another one for expediting the development of AI-powered game remasters.

Do you think that NPCs reacting to the real-life emotions of players dynamically will improve the immersion of games? Let us know your thoughts in the comments below, or join the discussion on the Tech4Gamers forum.

Was our article helpful? 👨‍💻

Thank you! Please share your positive feedback. 🔋

How could we improve this post? Please Help us. 😔

Gear Up For Latest News

Get exclusive gaming & tech news before it drops. Sign up today!

Join Our Community

Still having issues? Join the Tech4Gamers Forum for expert help and community support!

Latest News

Join Our Community

104,000FansLike
32,122FollowersFollow

Trending

I Thought Cheap AIO Coolers Performed Poorly Until I Found This

I thought Cheap AIO coolers seemed gimmicky and showed bad thermal, but these $72 and $54 liquid coolers completely proved me wrong.

Gamers Are Developers Now: The Rise of No-Code Game Tools

Discover how no-code game tools are turning everyday gamers into developers, making game creation more accessible than ever.

New Sony Patent Suggests PS6 To Support Hardware-Level Backward Compatibility Features

Sony has published a new patent that details a system to tune modern hardware in order to run legacy applications smoothly on the new device.

The Fortnite Experience On PS5 Is Fast, Fluid, And Fun

Fortnite not only looks good on the PS5, but it does so while running at an extremely smooth 60-120 frames per second.

How To Deal With Rising Video Game Prices

Games are becoming more expensive each day, but there are still many alternatives for those looking to enjoy the hobby in a limited budget.