Using Doppler to swap sign language headphones is breaking news for UB teachers and employees

Using Doppler to swap sign language headphones is breaking news for UB teachers and employees

Reported in the journal “Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies,” the headphone-based system uses Doppler technology to sense tiny fluctuations, or echoes, in acoustic soundwaves that are created by the hands of someone signing.

A UB-led research team has modified noise-cancelling headphones to enable the common electronic device to “see” and translate American Sign Language (ASL) when paired with a smartphone.

Dubbed SonicASL, the system proved 93.8% effective in tests performed indoors and outdoors involving 42 words. Word examples include “love,” “space” and “camera.” Under the same conditions involving 30 simple sentences — for example, “Nice to meet you.” — SonicASL was 90.6% effective.

“SonicASL is an exciting proof of concept that could eventually help greatly improve communication between deaf and hearing populations,” says corresponding author Zhanpeng Jin, associate professor in the Department of Computer Science and Engineering at UB.

But before such technology is commercially available, much work must be done, he stresses. For example, SonicASL’s vocabulary must be greatly expanded. Also, the system must be able to read facial expressions, a major component of ASL.

The study will be presented at the ACM Conference on Pervasive and Ubiquitous Computing (UbiComp), taking place Sept. 21-26.

Communication barriers persist
Sonic representation of the words, “I need your help.”.
These are the acoustic soundwaves created by signing the phrase “I need help.”

Worldwide, according to the World Federation of the Deaf, there are about 72 million deaf people using more than 300 different sign languages.

Although the United Nations recognizes that sign languages are equal in importance to the spoken word, that view is not yet a reality in many nations. People who are deaf or hard of hearing still experience multiple communication barriers. Traditionally, communication between deaf American Sign Language (ASL) users and hearing people who do not know the language takes place either in the presence of an ASL interpreter, or through a camera setup. A frequent concern regarding the use of cameras, according to Jin, includes whether those video recordings could be misused. And while the use of ASL interpreters is becoming more common, there is no guarantee that one will be available when needed. SonicASL aims to address these issues, especially in casual circumstances without pre-arranged planning and setup, Jin says. Concept illustration of how the headphones work to interpret sign language.
The illustration on the left shows the modifications made to the headphones. The right shows what a user sees on their smartphone. Photo: University at Buffalo. Modify headphones with speaker, add app
Most noise-cancelling headphones rely on an outward-facing microphone that picks up environmental noise. The headphones then produce an anti-sound — a soundwave with the same amplitude but with an inverted phase of the surrounding noise — to cancel the external noise. “We added an additional speaker next to the outward-facing microphone. We wanted to see if the modified headphone could sense moving objects, similar to radar,” says co-lead author Yincheng Jin (no relation), a PhD candidate in Jin’s lab. The speaker and microphone do indeed pick up hand movements. The information is relayed through the SonicASL cellphone app, which contains an algorithm the team created to identify the words and sentences. The app then translates the signs and speaks to the hearing person via the earphones. “We tested SonicASL under different environments, including office, apartment, corridor and sidewalk locations,” says co-lead author Yang Gao, who completed the research in Jin’s lab before becoming a postdoctoral scholar at Northwestern University. “Although it has seen a slight decrease in accuracy as overall environmental noises increase, the overall accuracy is still quite good because the majority of the environmental noises do not overlap or interfere with the frequency range required by SonicASL.” The core SonicASL algorithm can be implemented and deployed on any smartphone, he says. The use of Doppler to alter the headphones in sign language is newsflash for UB faculty and staff
Check all news and articles from the latest Security news updates.

For UB faculty and staff, using Doppler to switch sign language headphones is newsflash
Check all news and articles from the latest Security news updates.

The News Highlights

  • Using Doppler to swap sign language headphones is breaking news for UB teachers and employees
  • Check the latest update on Security news
  • .

Disclaimer: If you need to edit or update this news from compsmag then kindly contact us Learn more

For Latest News Follow us on Google News


Latest Headlines
  • Show all
  • Trending News
  • Popular By week
Top 5 Reasons Android Users Continue to Avoid Apple’s 13-Series iPhones
Top 5 Reasons Android Users Continue to Avoid Apple’s 13-Series iPhones
The Apple iPhone 13 Mini comes with a 5.4-inch display while the iPhone 13 uses a 6.1-inch screen. Both use an OLED panel, and there is an aluminum frame ...
Pandemic Led Man to Empty Savings, open Business in Alabama
Pandemic Led Man to Empty Savings, open Business in Alabama
Folmar was ready for a change and wanted to start his own business after working the nine-to-5 life so along came Jet Stream Clean. The commercial and ...
Strategy Analytics- US Businesses Show IoT Investment Elasticity Despite Pandemic
Strategy Analytics- US Businesses Show IoT Investment Elasticity Despite Pandemic
The Strategy Analytics End User Research highlights some interesting trends that have shaped the IoT landscape: BOSTON – Despite the adversity caused by the ...
Insider Q&A: Serving the Neglected for gain, Not Just Good
Insider Q&A: Serving the Neglected for gain, Not Just Good
Q: When did you start trying to marry profits with purpose in your investment career? A couple decades ago, convincing investors that they could make money ...
Due to the PC version of Call of Duty: Vanguard, cheaters wrecked the beta
Due to the PC version of Call of Duty: Vanguard, cheaters wrecked the beta
Black Ops Cold War and Warzone have been fighting an apparently losing battle against cheats over the course of the last year, and it was hoped that the ...
Can Microsoft’s foldable improve enough for us to recommend it?
Can Microsoft’s foldable improve enough for us to recommend it?
The Surface Duo is a compelling first generation folding phone, but a lack of software optimisation and some dated specs hold it back. Nonetheless, there’s ...
Leaked Surface Pro 8 specs include Thunderbolt ports and a 120 Hz screen
Leaked Surface Pro 8 specs include Thunderbolt ports and a 120 Hz screen
While the renders have been faked, the specifications are in line what The Verge has already revealed. Ultimately, the Chinese retailer may have read The ...
Apple insider leaks first iPhone 15 details and foldable iPhone release timing
Apple insider leaks first iPhone 15 details and foldable iPhone release timing
Apple is nowhere near ready to launch a foldable iPhone. But the company is  A reliable leaker that said in the past that Apple is interested in making ...
Apple 10 years later, with Tim Cook at the helm
Apple 10 years later, with Tim Cook at the helm
A company that turns a web of complex components into sophisticated computing devices now makes more money than those that effectively pump barrels of cash ...
Apple recently updated its iOS 15 features page to highlight some additional information about the software update ahead of its imminent release.  iOS 15 Messages Feature In addition to revealing that Find My network support for AirPods Pro and AirPods Max has been delayed until “later this fall,” Apple said iOS 15 allows users to seamlessly switch between phone numbers in the middle of an iMessage conversation on an iPhone with Dual SIM support, including the iPhone XS, iPhone XS Max, iPhone XR, and newer.  Regional updates to the page include the addition of Japanese in the list of new Voice Control languages and the addition of Singapore for countries with air quality maps in the Weather app on iOS 15. Apple has also revealed that iOS 15 has a new SF Arabic system font, and in India, users can choose from up to 10 of their most recently used UPI payment apps when they scan UPI QR codes using the Camera app for merchant payments.  Apple labeled iCloud Private Relay as a beta feature last month, and the iOS 15 features page now states that when using Private Relay, some websites may have issues, such as showing content for the wrong region or requiring extra steps to sign in. This mirrors fine print added to the iCloud Private Relay section of the Settings app on iPhone.  iOS 15 will be released tomorrow following over three months of beta testing. The software update is compatible with the same iPhones as iOS 14, including older devices like the original iPhone SE and iPhone 6s.
Apple recently updated its iOS 15 features page to highlight some additional information about the software update ahead of its imminent release. iOS 15 Messages Feature In addition to revealing that Find My network support for AirPods Pro and AirPods Max has been delayed until “later this fall,” Apple said iOS 15 allows users to seamlessly switch between phone numbers in the middle of an iMessage conversation on an iPhone with Dual SIM support, including the iPhone XS, iPhone XS Max, iPhone XR, and newer. Regional updates to the page include the addition of Japanese in the list of new Voice Control languages and the addition of Singapore for countries with air quality maps in the Weather app on iOS 15. Apple has also revealed that iOS 15 has a new SF Arabic system font, and in India, users can choose from up to 10 of their most recently used UPI payment apps when they scan UPI QR codes using the Camera app for merchant payments. Apple labeled iCloud Private Relay as a beta feature last month, and the iOS 15 features page now states that when using Private Relay, some websites may have issues, such as showing content for the wrong region or requiring extra steps to sign in. This mirrors fine print added to the iCloud Private Relay section of the Settings app on iPhone. iOS 15 will be released tomorrow following over three months of beta testing. The software update is compatible with the same iPhones as iOS 14, including older devices like the original iPhone SE and iPhone 6s.
iOS 15 Messages Feature In addition to revealing that Find My network support for AirPods Pro and AirPods Max has been delayed until “later this fall,” Apple ...
Show next
Compsmag - Latest News from tech, business and health
Logo