Xbox One | 360 | XBLA  PS4 | PS3 | PSN  Wii U | VC    3DS  PS Vita  iOS    PC    Retro    

  » news
  » reviews
  » previews
  » cheat codes
  » release dates
  » screenshots
  » videos

  » specials
  » interviews

  » facebook
  » twitter
  » contests

  » games list
  » franchises
  » companies
  » genres
  » staff

Which game are you looking forward to the most?

Fallout 4
Super Mario Maker
Halo 5: Guardians
Rise of the Tomb Raider
Star Wars: Battlefront

 Written by Brandon Hofer  on July 18, 2013

News: Microsoft Research Asia has developed a way where Kinect can read and recognize human sign language.

Kinect Sign Language

Kinect has a lot of uses for gaming but what about non-gaming applications? It appears that Kinect is creating something quite revolutionary in the field of Natural User Interface. At the Institute of Computing Tech at Beijing Union University, Microsoft Research Asia has developed a way where the Kinect can read human sign language with ease. Sign language is the primary language for those who may be deaf or hard of hearing, however, you can’t really communicate with your computer using sign language. Microsoft Research Asia has developed a system which allows Kinect to detect sign languages used by people and, according to them, it works well. Here is what they had to say:

Kinect, with its ability to provide depth information and color data simultaneously, makes it easier to track hand and body actions more accurately—and quickly.

In this project—which is being shown during the demofest portion of faculty summit 2013, which brings more than 400 academic researchers to Microsoft headquarters to share insight into impactful research—the hand tracking leads to a process of 3-D motion-trajectory alignment and matching for individual words in sign language. The words are generated via hand tracking by the kinect for windows software and then normalized, and matching scores are computed to identify the most relevant candidates when a signed word is analyzed.

The algorithm for this 3-D trajectory matching, in turn, has enabled the construction of a system for sign-language recognition and translation, consisting of two modes. The first, Translation Mode, translates sign language into text or speech. The technology currently supports American sign language but has potential for all varieties of sign language.
The second, Communications Mode, enables communications between a hearing person and a deaf or hard-of-hearing person by use of an avatar. Guided by text input from a keyboard, the avatar can display the corresponding sign-language sentence. The deaf or hard-of-hearing person responds using sign language, and the system converts that answer into text.

It all sounds pretty amazing to me. While they certainly didn’t have gaming in mind here what do you think this could bring to Kinect on Xbox 360 or the far more powerful Kinect 2.0 on Xbox One? It would seem the possibilities are endless.

User Comments

Bungie Reveals Tess is Returning to the Tower With a New In-Game Currency in Destiny

Guitar Hero Live Trailer Released With James Franco and Lenny Kravitz

Project Spark Transitioning to Free Incubation Engine Beginning Today

Rock Band 4 Electric Trailer Released Ahead of Tomorrow’s Release

Assassin’s Creed: The Complete Visual History Being Released Next Week

Destiny: The Taken King Accolades Trailer Released by Activision

Minecraft Story Mode Episode One Trailer Released by Telltale Games

Skylanders SuperChargers Review - Race to Save Skylands From the Evil Kaos and The Darkness

NBA Live 16 Now Available on Xbox One and PlayStation 4 from EA Sports

Call of Duty Black Ops III Story Trailer Released by Activision

Home    •    About Us    •    Contact Us    •    Advertise    •    Jobs    •    Privacy Policy    •    Site Map
Copyright ©1999-2012 Matt Swider. All rights reserved. Site Programming copyright © 2004 Bill Nelepovitz - NeositeCMS