For UB teachers and staff, the use of Doppler to change the headphones in sign language is breaking news

For UB teachers and staff, the use of Doppler to change the headphones in sign language is breaking news

Dubbed SonicASL, the system proved 93.8% effective in tests performed indoors and outdoors involving 42 words. Word examples include “love,” “space” and “camera.” Under the same conditions involving 30 simple sentences — for example, “Nice to meet you.” — SonicASL was 90.6% effective.

A UB-led research team has modified noise-cancelling headphones to enable the common electronic device to “see” and translate American Sign Language (ASL) when paired with a smartphone.

Reported in the journal “Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies,” the headphone-based system uses Doppler technology to sense tiny fluctuations, or echoes, in acoustic soundwaves that are created by the hands of someone signing.

“SonicASL is an exciting proof of concept that could eventually help greatly improve communication between deaf and hearing populations,” says corresponding author Zhanpeng Jin, associate professor in the Department of Computer Science and Engineering at UB.

The study will be presented at the ACM Conference on Pervasive and Ubiquitous Computing (UbiComp), taking place Sept. 21-26.

But before such technology is commercially available, much work must be done, he stresses. For example, SonicASL’s vocabulary must be greatly expanded. Also, the system must be able to read facial expressions, a major component of ASL.

Communication barriers persist
Sonic representation of the words, “I need your help.”.
These are the acoustic soundwaves created by signing the phrase “I need help.”

Worldwide, according to the World Federation of the Deaf, there are about 72 million deaf people using more than 300 different sign languages.

Although the United Nations recognizes that sign languages are equal in importance to the spoken word, that view is not yet a reality in many nations. People who are deaf or hard of hearing still experience multiple communication barriers. Traditionally, communication between deaf American Sign Language (ASL) users and hearing people who do not know the language takes place either in the presence of an ASL interpreter, or through a camera setup. A frequent concern regarding the use of cameras, according to Jin, includes whether those video recordings could be misused. And while the use of ASL interpreters is becoming more common, there is no guarantee that one will be available when needed. SonicASL aims to address these issues, especially in casual circumstances without pre-arranged planning and setup, Jin says. Concept illustration of how the headphones work to interpret sign language.
The illustration on the left shows the modifications made to the headphones. The right shows what a user sees on their smartphone. Photo: University at Buffalo. Modify headphones with speaker, add app
Most noise-cancelling headphones rely on an outward-facing microphone that picks up environmental noise. The headphones then produce an anti-sound — a soundwave with the same amplitude but with an inverted phase of the surrounding noise — to cancel the external noise. “We added an additional speaker next to the outward-facing microphone. We wanted to see if the modified headphone could sense moving objects, similar to radar,” says co-lead author Yincheng Jin (no relation), a PhD candidate in Jin’s lab. The speaker and microphone do indeed pick up hand movements. The information is relayed through the SonicASL cellphone app, which contains an algorithm the team created to identify the words and sentences. The app then translates the signs and speaks to the hearing person via the earphones. “We tested SonicASL under different environments, including office, apartment, corridor and sidewalk locations,” says co-lead author Yang Gao, who completed the research in Jin’s lab before becoming a postdoctoral scholar at Northwestern University. “Although it has seen a slight decrease in accuracy as overall environmental noises increase, the overall accuracy is still quite good because the majority of the environmental noises do not overlap or interfere with the frequency range required by SonicASL.” The core SonicASL algorithm can be implemented and deployed on any smartphone, he says.

The use of Doppler to alter the headphones in sign language is newsflash for UB faculty and staff
Check all news and articles from the latest Security news updates.

The News Highlights

  • For UB teachers and staff, the use of Doppler to change the headphones in sign language is breaking news
  • Check the latest update on Security news
  • .

Disclaimer: If you need to edit or update this news from compsmag then kindly contact us Learn more

For Latest News Follow us on Google News


Latest Headlines
  • Show all
  • Trending News
  • Popular By week
Indian Farmers Renew Protests, Defying Modi’s Government
Indian Farmers Renew Protests, Defying Modi’s Government
“The enthusiasm we had on the first day, it is much stronger and bigger now,” said Manjit Singh, a 45-year-old farmer and protester. Mohini Kaur, a ...
New York braces for a possible staff shortage as the COVID vaccine mandate for healthcare professionals approaches
New York braces for a possible staff shortage as the COVID vaccine mandate for healthcare professionals approaches
“CSEA is supportive of efforts to keep our state workplaces safer, but these changes must respect the legal bargaining rights of workers,” communications ...
The next in Motorola’s budget phone line, the Moto G Pure, has been leaked
The next in Motorola’s budget phone line, the Moto G Pure, has been leaked
The image shows a phone with a teardrop notch for the front-facing camera on top of the display. In the back, we can see a dual rear camera setup along with ...
Apply for Atlanta Emergency Rental Assistance Money While You Can
Maine blueberry growers have had a year of recovery, aided by rain.
Growers had a better year in part because of the cool, wet July, Yarborough said. Hot summers and droughts have hurt the crop in recent years. It was also a ...
The finest, the worst, and everything in between in 19 new Android games from the past week (9/19/21)
The finest, the worst, and everything in between in 19 new Android games from the past week (9/19/21)
Actraiser Renaissance was a surprise release this week. This is a remaster of one of Square Enix’s SNES games, and it’s a hard title to pin down to a single ...
COVID live updates: New South Wales and Victoria roll back some coronavirus restrictions
COVID live updates: New South Wales and Victoria roll back some coronavirus restrictions
By Alexis Moran Key Event16m ago16 minutes agoSun 26 Sep 2021 at 9:31pm What does the tourism industry make of all the mixed messaging around borders opening ...
L’ordinateur has a Dell XPS 13 9300 laptop for French Days
L’ordinateur has a Dell XPS 13 9300 laptop for French Days
On the first try, it’s a masterstroke. We were skeptical about the performance of the new Apple M1 processor in real conditions and we must admit we were ...
Everything You Need To Know About The Factory Drag Car: The Dodge Hemi Dart
Everything You Need To Know About The Factory Drag Car: The Dodge Hemi Dart
But today, we’re honoring an American car from the 1960s whose spiritual successor has one of the most famed names in performance car history – Demon. Its ...
PS5 restock dates in the UK are live: Asda, Game, Argos, and Very are all restocking today
PS5 restock dates in the UK are live: Asda, Game, Argos, and Very are all restocking today
August was one of the best months ever for PS5 restocks, seeing multiple drops at Very, Smyths Toys, BT and EE, as well as availability at Argos, Amazon and ...
Crypto Shadow Banking explained and why 12% of earnings are common
3 Financial Lessons To Teach Your Kids This Year
My younger children don’t quite understand what a budget is, but my fourth grader not only knows what it means to budget, but has actually seen my household ...
Show next
Compsmag - Latest News from tech, business and health
Logo