For UB faculty and staff, the use of Doppler to distribute headphones in sign language is breaking news

For UB faculty and staff, the use of Doppler to distribute headphones in sign language is breaking news

Dubbed SonicASL, the system proved 93.8% effective in tests performed indoors and outdoors involving 42 words. Word examples include “love,” “space” and “camera.” Under the same conditions involving 30 simple sentences — for example, “Nice to meet you.” — SonicASL was 90.6% effective

A UB-led research team has modified noise-cancelling headphones to enable the common electronic device to “see” and translate American Sign Language (ASL) when paired with a smartphone.

Reported in the journal “Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies,” the headphone-based system uses Doppler technology to sense tiny fluctuations, or echoes, in acoustic soundwaves that are created by the hands of someone signing.

“SonicASL is an exciting proof of concept that could eventually help greatly improve communication between deaf and hearing populations,” says corresponding author Zhanpeng Jin, associate professor in the Department of Computer Science and Engineering at UB.

The study will be presented at the ACM Conference on Pervasive and Ubiquitous Computing (UbiComp), taking place Sept. 21-26.

But before such technology is commercially available, much work must be done, he stresses. For example, SonicASL’s vocabulary must be greatly expanded. Also, the system must be able to read facial expressions, a major component of ASL.

Communication barriers persist
Sonic representation of the words, “I need your help.”.
These are the acoustic soundwaves created by signing the phrase “I need help.”

Worldwide, according to the World Federation of the Deaf, there are about 72 million deaf people using more than 300 different sign languages.

Although the United Nations recognizes that sign languages are equal in importance to the spoken word, that view is not yet a reality in many nations. People who are deaf or hard of hearing still experience multiple communication barriers. Traditionally, communication between deaf American Sign Language (ASL) users and hearing people who do not know the language takes place either in the presence of an ASL interpreter, or through a camera setup. A frequent concern regarding the use of cameras, according to Jin, includes whether those video recordings could be misused. And while the use of ASL interpreters is becoming more common, there is no guarantee that one will be available when needed. SonicASL aims to address these issues, especially in casual circumstances without pre-arranged planning and setup, Jin says. Concept illustration of how the headphones work to interpret sign language.
The illustration on the left shows the modifications made to the headphones. The right shows what a user sees on their smartphone. Photo: University at Buffalo. Modify headphones with speaker, add app
Most noise-cancelling headphones rely on an outward-facing microphone that picks up environmental noise. The headphones then produce an anti-sound — a soundwave with the same amplitude but with an inverted phase of the surrounding noise — to cancel the external noise. “We added an additional speaker next to the outward-facing microphone. We wanted to see if the modified headphone could sense moving objects, similar to radar,” says co-lead author Yincheng Jin (no relation), a PhD candidate in Jin’s lab. The speaker and microphone do indeed pick up hand movements. The information is relayed through the SonicASL cellphone app, which contains an algorithm the team created to identify the words and sentences. The app then translates the signs and speaks to the hearing person via the earphones. “We tested SonicASL under different environments, including office, apartment, corridor and sidewalk locations,” says co-lead author Yang Gao, who completed the research in Jin’s lab before becoming a postdoctoral scholar at Northwestern University. “Although it has seen a slight decrease in accuracy as overall environmental noises increase, the overall accuracy is still quite good because the majority of the environmental noises do not overlap or interfere with the frequency range required by SonicASL.” The core SonicASL algorithm can be implemented and deployed on any smartphone, he says. The use of Doppler to alter the headphones in sign language is newsflash for UB faculty and staff
Check all news and articles from the latest Security news updates. For UB faculty and staff, using Doppler to switch sign language headphones is newsflash
Check all news and articles from the latest Security news updates. The use of Doppler to exchange sign language headphones is newsflash for UB teachers and employees
Check all news and articles from the latest Security news updates. For UB teachers and staff, the use of Doppler to share sign language headphones is newsflash
Check all news and articles from the latest Security news updates.

The use of Doppler to distribute headphones in sign language is newsflash for UB faculty and employees
Check all news and articles from the latest Security news updates.

The News Highlights

  • For UB faculty and staff, the use of Doppler to distribute headphones in sign language is breaking news
  • Check the latest update on Security news
  • .

Disclaimer: If you need to edit or update this news from compsmag then kindly contact us Learn more

For Latest News Follow us on Google News


Latest Headlines
  • Show all
  • Trending News
  • Popular By week
FireEye will host virtual product and strategy update for financial analysts and investors on Monday, October 4, 2021
FireEye will host virtual product and strategy update for financial analysts and investors on Monday, October 4, 2021
© 2021 FireEye, Inc. All rights reserved. FireEye and Mandiant are registered trademarks or trademarks of FireEye, Inc. in the United States and other ...
COVID death toll in India exceeds 400,000 - half died in second wave |  Coronavirus Pandemic News
Bucs Place WR Antonio Brown Covid List, Bucs Vs. Rams Roster Moves
Brown joined the Buccaneers in midseason last year and recorded 45 catches for 483 yards and four touchdowns in eight games. He also caught eight passes ...
Best smartphones of 2021
Best smartphones of 2021
Fortunately, we’ve tested all of the top smartphones released in 2021 to help you make the right call. Here are the ones we found to be the best: ...
Cryptographic funding for Palestine’s Hamas approaches $1 million and far exceeds funding for other militant groups, says Coinbase |  Currency News |  Financial and  News News
Cryptographic funding for Palestine’s Hamas approaches $1 million and far exceeds funding for other militant groups, says Coinbase | Currency News | Financial and News News
Coinbase Coinbase described Hamas’ fundraising efforts as “staggering” in comparison to other organizations it analyzed. The militant group first ...
The Case of Disappeared Van life Blogger, Gabby Petito and How it Took All Over the Internet
The Case of Disappeared Van life Blogger, Gabby Petito and How it Took All Over the Internet
In July, Ms. Petito, 22, embarked from New York on a cross-country road trip with her fiancé, Brian Laundrie, 23. As they made their way out West in a white ...
Financial Severity Responds to Attacks on Legitimate Tax Planning
Ida Thursday recovery meeting for agricultural producers
The meeting is for landowners, farmers and producers in Orleans, Jefferson, St. Bernard, Plaquemines, St. Charles and surrounding parishes. Supporting ...
Four phones, not ‘Huawei’, could be banned by Biden over ‘security fears’
Four phones, not ‘Huawei’, could be banned by Biden over ‘security fears’
According to the Washington Post, personnel at four agencies met last week to discuss putting Honor on the Commerce Department’s entity list. US SECURITY ...
Millions of iPhones, TVs and other devices may cripple internet access— Here’s why
Millions of iPhones, TVs and other devices may cripple internet access— Here’s why
That’s because a widely used digital certificate used to verify secure internet connections expires on Sept. 30, and millions of older devices won’t be able ...
The Taiwan Rating for the Castlevania Advance Collection Gets Updated With Key Art and More Details
The Taiwan Rating for the Castlevania Advance Collection Gets Updated With Key Art and More Details
The year is 2035 and Soma Cruz is about to witness the first solar eclipse of the 21st century when he suddenly blacks out – only to awaken inside a ...
The Vetster Android App Is Designed To Help With Pet Separation Anxiety
The Vetster Android App Is Designed To Help With Pet Separation Anxiety
So, what is Vetster? It is an app that can connect you to a veterinarian at any time during the day… or night. This service is available 24/7, so that you ...
Show next
Compsmag - Latest News from tech, business and health
Logo