The use of Doppler to distribute sign language headphones is breaking news for UB faculty and employees

The use of Doppler to distribute sign language headphones is breaking news for UB faculty and employees

Reported in the journal “Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies,” the headphone-based system uses Doppler technology to sense tiny fluctuations, or echoes, in acoustic soundwaves that are created by the hands of someone signing.

A UB-led research team has modified noise-cancelling headphones to enable the common electronic device to “see” and translate American Sign Language (ASL) when paired with a smartphone.

Dubbed SonicASL, the system proved 93.8% effective in tests performed indoors and outdoors involving 42 words. Word examples include “love,” “space” and “camera.” Under the same conditions involving 30 simple sentences — for example, “Nice to meet you.” — SonicASL was 90.6% effective.

“SonicASL is an exciting proof of concept that could eventually help greatly improve communication between deaf and hearing populations,” says corresponding author Zhanpeng Jin, associate professor in the Department of Computer Science and Engineering at UB.

But before such technology is commercially available, much work must be done, he stresses. For example, SonicASL’s vocabulary must be greatly expanded. Also, the system must be able to read facial expressions, a major component of ASL.

The study will be presented at the ACM Conference on Pervasive and Ubiquitous Computing (UbiComp), taking place Sept. 21-26.

Communication barriers persist
Sonic representation of the words, “I need your help.”.
These are the acoustic soundwaves created by signing the phrase “I need help.”

Worldwide, according to the World Federation of the Deaf, there are about 72 million deaf people using more than 300 different sign languages.

Although the United Nations recognizes that sign languages are equal in importance to the spoken word, that view is not yet a reality in many nations. People who are deaf or hard of hearing still experience multiple communication barriers. Traditionally, communication between deaf American Sign Language (ASL) users and hearing people who do not know the language takes place either in the presence of an ASL interpreter, or through a camera setup. A frequent concern regarding the use of cameras, according to Jin, includes whether those video recordings could be misused. And while the use of ASL interpreters is becoming more common, there is no guarantee that one will be available when needed. SonicASL aims to address these issues, especially in casual circumstances without pre-arranged planning and setup, Jin says. Concept illustration of how the headphones work to interpret sign language.
The illustration on the left shows the modifications made to the headphones. The right shows what a user sees on their smartphone. Photo: University at Buffalo. Modify headphones with speaker, add app
Most noise-cancelling headphones rely on an outward-facing microphone that picks up environmental noise. The headphones then produce an anti-sound — a soundwave with the same amplitude but with an inverted phase of the surrounding noise — to cancel the external noise. “We added an additional speaker next to the outward-facing microphone. We wanted to see if the modified headphone could sense moving objects, similar to radar,” says co-lead author Yincheng Jin (no relation), a PhD candidate in Jin’s lab. The speaker and microphone do indeed pick up hand movements. The information is relayed through the SonicASL cellphone app, which contains an algorithm the team created to identify the words and sentences. The app then translates the signs and speaks to the hearing person via the earphones. “We tested SonicASL under different environments, including office, apartment, corridor and sidewalk locations,” says co-lead author Yang Gao, who completed the research in Jin’s lab before becoming a postdoctoral scholar at Northwestern University. “Although it has seen a slight decrease in accuracy as overall environmental noises increase, the overall accuracy is still quite good because the majority of the environmental noises do not overlap or interfere with the frequency range required by SonicASL.” The core SonicASL algorithm can be implemented and deployed on any smartphone, he says. The use of Doppler to alter the headphones in sign language is newsflash for UB faculty and staff
Check all news and articles from the latest Security news updates. For UB faculty and staff, using Doppler to switch sign language headphones is newsflash
Check all news and articles from the latest Security news updates. The use of Doppler to exchange sign language headphones is newsflash for UB teachers and employees
Check all news and articles from the latest Security news updates.

For UB teachers and staff, the use of Doppler to share sign language headphones is newsflash
Check all news and articles from the latest Security news updates.

The News Highlights

  • The use of Doppler to distribute sign language headphones is breaking news for UB faculty and employees
  • Check the latest update on Security news
  • .

Disclaimer: If you need to edit or update this news from compsmag then kindly contact us Learn more

For Latest News Follow us on Google News


Latest Headlines
  • Show all
  • Trending News
  • Popular By week
The pandemic has hurt the restaurant business hard ‘That’s giving a chance to some immigrant women in Denver’
The pandemic has hurt the restaurant business hard ‘That’s giving a chance to some immigrant women in Denver’
“I emotion cumin (but) the concealed constituent is love,” she says. “Love with a small spot of passion.” Most mornings, Silvia Hernandez hardly has clip to ...
CrossFit champions designed Dottir’s true wireless earbuds
CrossFit champions designed Dottir’s true wireless earbuds
Designed by Katrin Davidsdottir and Annie Thorisdottir – both two-time “World’s Fittest Woman” winners at the CrossFit Games Women’s Championship, the Dottir ...
Gas price rise to drive more UK suppliers out of market, officials say
Gas price rise to drive more UK suppliers out of market, officials say
Natural gas prices have spiked as economies reopened from COVID-19 lockdowns and as high demand for liquefied natural gas in Asia pushed down supplies to ...
Police in Western Australia are tracking cell phones to apprehend alleged Perth quarantine breakers in the Goldfields
Police in Western Australia are tracking cell phones to apprehend alleged Perth quarantine breakers in the Goldfields
The couple were picked up driving on Goldfields Highway near Leonora They had been ordered to self-quarantine in suburban Perth A woman wanting to attend the ...
Milwaukee company purchases warehousing space in Janesville
Milwaukee company purchases warehousing space in Janesville
Zilber Property Group announced Tuesday it has acquired 500,000 square feet of industrial buildings along the Interstate 90/39 corridor on Janesville’s south ...
New Skyworth OLED Android TVs Are On Their Way To The United States
New Skyworth OLED Android TVs Are On Their Way To The United States
There are two different models that come to the states Both of these TVs are going to be on the higher end of the spectrum. The only difference between them ...
From English studio Glowmade, Amazon moves further into video game publishing with new project
From English studio Glowmade, Amazon moves further into video game publishing with new project
This has expanded Amazon’s third-party publishing work, and its game Department has brought projects from other companies to market. In addition, it has also ...
U.S. Bancorp purchases Union Bank in $8 Billion Deal
U.S. Bancorp purchases Union Bank in $8 Billion Deal
Shares in U.S. Bancorp (ticker: USB) rose 1.3% in midday trading, while U.S.-listed shares of Mitsubishi UFJ Financial Group (MUFG)—the owner of MUFG ...
Brave, the startup behind the non-tracking browser-based video conferencing tool is out of beta
Brave, the startup behind the non-tracking browser-based video conferencing tool is out of beta
The tool, called Brave Talk, has been in beta testing since May last year. And Brave told us it’s had some 14,000 daily active users over this period — aka, ...
Kena: Bridge of Spirits Is Another Fantastic PS5 and PS4 Game
Kena: Bridge of Spirits Is Another Fantastic PS5 and PS4 Game
However generally, we focus on what’s so nice about Kena’s gameplay and world, and why you will wish to decide up Ember Lab’s first sport on PS4 or PS5. ...
Show next
Compsmag - Latest News from tech, business and health
Logo