Sony Patents To Add Real-Time Sign Language Translator In Its Games

Expert Verified By

A Patent to Change Gaming Forever!

Story Highlight
  • A new patent published by Sony wants to add a real-time sign language translator in its video games.
  • It aims to help deaf gamers communicate seamlessly in real-time by understanding each other’s sign languages. 
  • To ensure effective communication, the system can differentiate between simple gestures and many sign languages.

Sony is always trying to one-up the competition by securing a plethora of unique ideas to bring innovation to the gaming industry. These ideas usually first appear in the form of patents, and this new one might change gaming for the better. A recent patent published by the company now wants to add a translator for sign languages in its games.

We have spotted a patent that discusses adding a real-time sign language translator in its games to help the disabled gaming community. It talks about how various sign languages can be translated during active conversations using avatars or their hands performing sign gestures to help deaf gamers communicate better.

“The graphical illustrations can include a pair of hands of an avatar, or an avatar with a face and arms performing the sign gestures.”

Why it matters: Sony publishing a patent to add a real-time sign language translator to its games could mean that it plans to implement this proposed system as an actual feature. It could change gaming for the deaf community.

The image shows a concept of a system providing feedback to a user regarding recognition of their signed communication | Image Source: Patentscope
The image by Sony shows the concept of a system providing feedback to a user regarding recognition of their signed communication | Image Source: Patentscope

The patent dubbed “TRANSLATION OF SIGN LANGUAGE IN A VIRTUAL ENVIRONMENT” describes its functionality by discussing how it’d work between two users. An English user may try to talk with a Japanese user using sign language; the English sign language gestures would first be translated into text, which would then be converted into Japanese before that is turned into Japanese sign language gestures.

Sony argues that sign languages differ around the globe, making it essential for them to be translated in real-time during active conversations to help deaf gamers understand each other in games.

“sign language is not universal. This provides a need for appropriately capturing the sign language of one user, understanding the native language, and generating new sign language as output for another user in their native sign language.”

The image shows concept of the system with two users that are remotely situated interacting using sign language | Image Source: Patentscope
A concept of the system with two users that are remotely situated, interacting using sign language | Image Source: Patentscope

Sony also ensures that the system can differentiate between simple gestures and sign languages to ensure users can still have an immersive experience. It is worth noting that Sony implies that this system can be employed in VR games, traditional titles, and other various non-gaming applications.

While a real-time translator for sign languages sounds enticing, it may never be added to Sony’s games for years to come. So, take it with a grain of salt.

For instance, it has previously published a legal document to automatically create variations of existing sound effects in games. The company has also previously secured a patent about the PS3’s backward compatibility with PS5, which corroborated a popular rumor. 

Was our article helpful? 👨‍💻

Thank you! Please share your positive feedback. 🔋

How could we improve this post? Please Help us. 😔

Gear Up For Latest News

Get exclusive gaming & tech news before it drops. Sign up today!

Join Our Community

Still having issues? Join the Tech4Gamers Forum for expert help and community support!

Latest News

Join Our Community

104,000FansLike
32,122FollowersFollow

Trending

Epic Games Accuses Valve of “Illegal” Methods Over Steam Microtransactions and Fees

Epic Game's CEO accuess Valve, stating that the company still employs excessive commissions and pricing structures that he claims are illegal.

Bethesda Veteran Says Starfield Would’ve Been A Hit If It Was Developed By Some Other Studio

Skyrim lead says if a new, smaller studio developed Starfield, it would've been a hit, because the expectations from Bethesda were too high.

Modders Unlock Multi-Frame Generation Alongside FSR 4, Results Shown On The RX 7900

Modders have now managed to enable FSR 4 and Multi Frame Gen on the 4-year-old RX 7900 and showcased it by running Cyberpunk 2077.

Ex-Rockstar Dev Praises Crimson Desert: “I’m Impressed With The Game”

A former Rockstar developer has reacted to Crimson Desert's latest gameplay, sharing nothing but positive words for the RPG.

Resident Evil Requiem Will Be Less Scary Than RE7, But Still An Improvement Over Village

Resident Evil Requiem director Koshi Nakanishi says that Capcom has toned down the horror in the game since players found RE7 too scary.