{"id":402458,"date":"2022-09-09T12:43:37","date_gmt":"2022-09-09T10:43:37","guid":{"rendered":"https:\/\/innovationorigins.com\/?post_type=selected&p=402458"},"modified":"2022-09-09T12:43:37","modified_gmt":"2022-09-09T10:43:37","slug":"hearing-aids-could-read-lips-through-masks","status":"publish","type":"selected","link":"https:\/\/ioplus.nl\/archive\/en\/selected\/hearing-aids-could-read-lips-through-masks\/","title":{"rendered":"Hearing aids could read lips through masks"},"content":{"rendered":"\n

A new system capable of reading lips with remarkable accuracy even when speakers are wearing face masks could help create a new generation of hearing aids. An international team of engineers and computing scientists developed the technology, which pairs radio-frequency sensing with artificial intelligence for the first time to identify lip movements, writes the University of Glasgow in a press release<\/a>.<\/p>\n\n\n\n

The system, when integrated with conventional hearing aid technology, could help tackle the \u2018cocktail party effect, a common shortcoming of traditional hearing aids. Currently, hearing aids assist hearing-impaired people by amplifying all ambient sounds around them, which can be helpful in many aspects of everyday life. <\/p>\n\n\n\n

However, in noisy situations such as cocktail parties, hearing aids\u2019 broad spectrum of amplification can make it difficult for users to focus on specific sounds, like a conversation with a particular person. One potential solution to the cocktail party effect is to make \u2018smart\u2019 hearing aids, which combine conventional audio amplification with a second device to collect additional data for improved performance.<\/p>\n\n\n\n

Why we write about this topic:<\/summary>

Around 5 percent of the world’s population suffers from some kind of hearing impairment. New technologies in this realm help foster equality and inclusiveness for all. <\/p><\/div><\/details>\n\n\n\n

Gathering data<\/h2>\n\n\n\n

To develop the system, the researchers asked male and female volunteers to repeat the five vowel sounds (A, E, I, O, and U) first while unmasked and then while wearing a surgical mask. As the volunteers repeated the vowel sounds, their faces were scanned using radio-frequency signals from both a dedicated radar sensor and a wifi transmitter. Their faces were also scanned while their lips remained still.<\/p>\n\n\n\n

Then, the 3,600 samples of data collected during the scans were used to \u2018teach\u2019 machine learning and deep learning algorithms how to recognize the characteristic lip and mouth movements associated with each vowel sound. Because the radio-frequency signals can easily pass through the volunteers\u2019 masks, the algorithms could also learn to read masked users\u2019 vowel formation.<\/p>\n\n\n

<\/a>
\"VR\"<\/div><\/div>
Virtual training enhances hearing<\/div>
Researchers from the Technical University of Denmark (DTU) and Danish hospital Rigshospitalet in Copenhagen have discovered a way to improve the sound experience for the hearing impaired. <\/div><\/div><\/div>\n\n\n

High success rates<\/h2>\n\n\n\n

The system proved to be capable of correctly reading the volunteers\u2019 lips most of the time. Wifi data was correctly interpreted by the learning algorithms up to 95 percent of the time for unmasked lips, and 80 percent for masked. Meanwhile, the radar data was interpreted correctly up to 91% without a mask and 83 percent of the time with a mask.<\/p>\n\n\n\n

Dr Qammer Abbasi, of the University of Glasgow\u2019s James Watt School of Engineering, is the paper\u2019s lead author. He said: \u201cWith this research, we have shown that radio-frequency signals can be used to accurately read vowel sounds on people\u2019s lips, even when their mouths are covered. While the results of lip-reading with radar signals are slightly more accurate, the Wi-Fi signals also demonstrated impressive accuracy.”<\/p>\n","protected":false},"author":2084,"featured_media":516616,"template":"","meta":{"_acf_changed":false,"advgb_blocks_editor_width":"","advgb_blocks_columns_visual_guide":""},"categories":[34665],"tags":[29080,56284,128531,61647],"location":[55977],"internal_archives":[],"class_list":["post-402458","selected","type-selected","status-publish","has-post-thumbnail","hentry","category-health","tag-artificial-intelligence-en","tag-hearing-aids","tag-hearing-impairment","tag-university-of-glasgow","location-united-kingdom"],"blocksy_meta":[],"acf":[],"featured_img":"https:\/\/ioplus.nl\/archive\/wp-content\/uploads\/2022\/02\/Oem77zMh-I3utKGM0-xJMScyx1-Schermafbeelding-2022-02-15-om-13.05.56.png","coauthors":[],"author_meta":{"author_link":"https:\/\/ioplus.nl\/archive\/author\/mauro-mereu\/","display_name":"Mauro Mereu"},"relative_dates":{"created":"Posted 4 years ago","modified":"Updated 4 years ago"},"absolute_dates":{"created":"Posted on September 9, 2022","modified":"Updated on September 9, 2022"},"absolute_dates_time":{"created":"Posted on September 9, 2022 12:43 pm","modified":"Updated on September 9, 2022 12:43 pm"},"featured_img_caption":"","tax_additional":{"category":{"linked":["Health<\/a>"],"unlinked":["Health<\/span>"],"slug":"category","name":"Categories"},"post_tag":{"linked":["Artificial Intelligence<\/a>","hearing aids<\/a>","hearing impairment<\/a>","University of Glasgow<\/a>"],"unlinked":["Artificial Intelligence<\/span>","hearing aids<\/span>","hearing impairment<\/span>","University of Glasgow<\/span>"],"slug":"post_tag","name":"Tags"},"language":{"linked":["EN<\/a>"],"unlinked":["EN<\/span>"],"slug":"language","name":"Tags"},"post_translations":{"linked":[],"unlinked":[],"slug":"post_translations","name":""},"location":{"linked":["United Kingdom<\/a>"],"unlinked":["United Kingdom<\/span>"],"slug":"location","name":"Locations"},"internal_archives":{"linked":[],"unlinked":[],"slug":"internal_archives","name":"Internal Archives"}},"series_order":"","_links":{"self":[{"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/selected\/402458","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/selected"}],"about":[{"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/types\/selected"}],"author":[{"embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/users\/2084"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/media\/516616"}],"wp:attachment":[{"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/media?parent=402458"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/categories?post=402458"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/tags?post=402458"},{"taxonomy":"location","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/location?post=402458"},{"taxonomy":"internal_archives","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/internal_archives?post=402458"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}