{"id":451608,"date":"2023-07-04T11:00:00","date_gmt":"2023-07-04T09:00:00","guid":{"rendered":"https:\/\/innovationorigins.com\/?p=451608"},"modified":"2023-07-04T11:00:00","modified_gmt":"2023-07-04T09:00:00","slug":"tool-automatically-detects-natural-disasters-using-social-media-images","status":"publish","type":"post","link":"https:\/\/ioplus.nl\/archive\/en\/tool-automatically-detects-natural-disasters-using-social-media-images\/","title":{"rendered":"Tool automatically detects natural disasters using social media images"},"content":{"rendered":"\n<p>A new deep learning system can detect natural disasters using images posted on social media. The international group of researchers applied computer vision tools that, once trained using\u00a01.7 million photographs, proved capable of\u00a0analyzing, filtering, and detecting real disasters, writes the Universitat Oberta de Catalunya (UOC) in a <a href=\"https:\/\/www.uoc.edu\/portal\/en\/news\/actualitat\/2023\/163-natural-disasters-social-media.html\">press release<\/a>. <\/p>\n\n\n\n<div class=\"io-block io-block__summary\"><ul><li>A computer vision system based on deep learning detects natural disasters by drawing from a database of social media images; <\/li><li>The model can avoid false positives; <\/li><li>This technology can speed up humanitarian aid during emergency situations; <\/li><\/ul><\/div>\n\n\n\n<p>As global warming progresses, natural disasters such as floods, tornadoes, and forest fires are ever more frequent and devastating. As there are still no tools to predict where or when such incidents will occur, it is vital that emergency services and international cooperation agencies can respond quickly and effectively to save lives. &#8220;Fortunately, technology can play a key role in these situations. Social media posts can be used as a low-latency data source to understand the progression and aftermath of a disaster,&#8221; \u00c0gata Lapedriza, professor of computer science at the UOC, explained.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Models for incidents <\/h2>\n\n\n\n<p>Previous research focused on analyzing text posts, but this research, published in\u00a0Transactions on Pattern Analysis and Machine Intelligence, went further. During a stay at the MIT Computer Science and Artificial Intelligence Laboratory, Lapedriza contributed to developing a taxonomy of incidents and the database used to train deep learning models and performed experiments to validate the technology.<\/p>\n\n\n\n<p>The researchers created a list with\u00a043 categories of incidents, including natural disasters (avalanches, sandstorms, earthquakes, volcanic eruptions, droughts, etc.) and accidents involving some element of human intervention (plane crashes, construction accidents, etc.). This list, together with\u00a049\u00a0place categories, enabled the researchers to label the images used to train the system.<\/p>\n\n\n\n<p>The authors created a database named Incidents1M, with 1,787,154 images that were then used to train the incident detection model. From among these images, 977,088 had at least one positive label linking them to one of the incident classifications, while 810,066 had class-negative labels. Meanwhile, for the place categories, 764,124 images had class-positive labels, and 1,023,030 were class-negative.<\/p>\n\n\n<div class=\"vlp-link-container vlp-layout-basic wp-block-visual-link-preview-link\"><a href=\"https:\/\/ioplus.nl\/archive\/en\/students-design-the-rescue-operations-of-tomorrow\/\" class=\"vlp-link\" title=\"Students design the rescue operations of tomorrow\"><\/a><div class=\"vlp-layout-zone-side\"><div class=\"vlp-block-2 vlp-link-image\"><\/div><\/div><div class=\"vlp-layout-zone-main\"><div class=\"vlp-block-0 vlp-link-title\">Students design the rescue operations of tomorrow<\/div><div class=\"vlp-block-1 vlp-link-summary\">Rescue operations are usually carried out in extreme weather conditions. Floods, storms, and heatwaves are some of the most frequent scenarios. <\/div><\/div><\/div>\n\n\n<h2 class=\"wp-block-heading\">Avoiding false positives<\/h2>\n\n\n\n<p>These negative labels meant the system could be trained to eliminate false positives; for example,\u00a0a photograph of a fireplace does not mean the house is on fire, even though it has some visual similarities. Once the database was constructed, the team trained a model to detect incidents &#8220;based on a multi-task learning paradigm and employing a convolutional neural network (CNN)&#8221;.<\/p>\n\n\n\n<p>When the deep learning model had been trained to detect incidents in images, the team ran a range of experiments to test it, using a huge volume of images downloaded from social media, including\u00a0Flickr\u00a0and\u00a0Twitter. &#8220;Our model was able to use these images to detect incidents, and we checked that they correspond to specific, recorded incidents, such as the 2015 earthquakes in Nepal and Chile,&#8221; Lapedriza said.<\/p>\n\n\n<div class=\"vlp-link-container vlp-layout-basic wp-block-visual-link-preview-link\"><a href=\"https:\/\/ioplus.nl\/archive\/en\/help-for-lifeguards-autonomous-aquatic-robot-rescues-drowning-victims\/\" class=\"vlp-link\" title=\"Help for lifeguards: Autonomous aquatic robot rescues drowning victims\"><\/a><div class=\"vlp-layout-zone-side\"><div class=\"vlp-block-2 vlp-link-image\"><\/div><\/div><div class=\"vlp-layout-zone-main\"><div class=\"vlp-block-0 vlp-link-title\">Help for lifeguards: Autonomous aquatic robot rescues drowning victims<\/div><div class=\"vlp-block-1 vlp-link-summary\">According to the German Lifesaving Society DLRG, nearly 420 people drowned in Germany in 2019. . Most fatal accidents occurred in inland waters such as lakes, ponds or rivers, but people also lost their lives in swimming pools.<\/div><\/div><\/div>\n\n\n<h2 class=\"wp-block-heading\">Helping humanitarian aid<\/h2>\n\n\n\n<p>Using real data, the authors demonstrated the potential of a tool based on deep learning for obtaining information from social media about natural disasters and incidents requiring humanitarian aid. &#8220;This will\u00a0help humanitarian aid organizations to find out what&#8217;s happening during disasters more effectively\u00a0and improve the way humanitarian aid is managed when needed,&#8221; she said.<\/p>\n\n\n\n<p>Following this achievement, the next challenge could be, for example, to use the same images of floods, fires or other incidents to automatically\u00a0determine the seriousness\u00a0of incidents or even to monitor them more effectively over time. The authors also suggested that the scientific community could follow up the research by combining the analysis of images with that of the accompanying text, to enable more accurate classification.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A new deep learning system can detect natural disasters using images posted on social media. The international group of researchers applied computer vision tools that, once trained using\u00a01.7 million photographs, proved capable of\u00a0analyzing, filtering, and detecting real disasters, writes the Universitat Oberta de Catalunya (UOC) in a press release. As global warming progresses, natural disasters [&hellip;]<\/p>\n","protected":false},"author":2589,"featured_media":495532,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"advgb_blocks_editor_width":"","advgb_blocks_columns_visual_guide":"","footnotes":""},"categories":[8553],"tags":[79338,54111,43784,79341],"location":[39958],"article_type":[36684],"serie":[],"archives":[],"internal_archives":[],"reboot-archive":[],"class_list":["post-451608","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-digital","tag-computer-models","tag-mit-en","tag-sensoren-nl","tag-universitat-oberta-de-catalunya","location-spain","article_type-news"],"blocksy_meta":[],"acf":{"subtitle":"A computer vision system based on deep learning detects natural disasters by drawing from a database of social media images. ","text_display_homepage":false},"author_meta":{"display_name":"Team IO","author_link":"https:\/\/ioplus.nl\/archive\/author\/erikdevries\/"},"featured_img":"https:\/\/ioplus.nl\/archive\/wp-content\/uploads\/2023\/07\/children-5833719_1280.png","coauthors":[],"tax_additional":{"categories":{"linked":["<a href=\"https:\/\/ioplus.nl\/archive\/en\/category\/digital\/\" class=\"advgb-post-tax-term\">Digital<\/a>"],"unlinked":["<span class=\"advgb-post-tax-term\">Digital<\/span>"]},"tags":{"linked":["<a href=\"https:\/\/ioplus.nl\/archive\/en\/category\/digital\/\" class=\"advgb-post-tax-term\">computer models<\/a>","<a href=\"https:\/\/ioplus.nl\/archive\/en\/category\/digital\/\" class=\"advgb-post-tax-term\">MIT<\/a>","<a href=\"https:\/\/ioplus.nl\/archive\/en\/category\/digital\/\" class=\"advgb-post-tax-term\">Sensoren<\/a>","<a href=\"https:\/\/ioplus.nl\/archive\/en\/category\/digital\/\" class=\"advgb-post-tax-term\">Universitat Oberta de Catalunya<\/a>"],"unlinked":["<span class=\"advgb-post-tax-term\">computer models<\/span>","<span class=\"advgb-post-tax-term\">MIT<\/span>","<span class=\"advgb-post-tax-term\">Sensoren<\/span>","<span class=\"advgb-post-tax-term\">Universitat Oberta de Catalunya<\/span>"]}},"comment_count":"0","relative_dates":{"created":"Posted 3 years ago","modified":"Updated 3 years ago"},"absolute_dates":{"created":"Posted on July 4, 2023","modified":"Updated on July 4, 2023"},"absolute_dates_time":{"created":"Posted on July 4, 2023 11:00 am","modified":"Updated on July 4, 2023 11:00 am"},"featured_img_caption":"","series_order":"","_links":{"self":[{"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/posts\/451608","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/users\/2589"}],"replies":[{"embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/comments?post=451608"}],"version-history":[{"count":0,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/posts\/451608\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/media\/495532"}],"wp:attachment":[{"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/media?parent=451608"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/categories?post=451608"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/tags?post=451608"},{"taxonomy":"location","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/location?post=451608"},{"taxonomy":"article_type","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/article_type?post=451608"},{"taxonomy":"serie","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/serie?post=451608"},{"taxonomy":"archives","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/archives?post=451608"},{"taxonomy":"internal_archives","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/internal_archives?post=451608"},{"taxonomy":"reboot-archive","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/reboot-archive?post=451608"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}