{"id":439456,"date":"2023-03-09T15:00:00","date_gmt":"2023-03-09T14:00:00","guid":{"rendered":"https:\/\/innovationorigins.com\/?post_type=selected&amp;p=439456"},"modified":"2023-03-09T15:00:00","modified_gmt":"2023-03-09T14:00:00","slug":"ai-captures-animal-motion","status":"publish","type":"selected","link":"https:\/\/ioplus.nl\/archive\/en\/selected\/ai-captures-animal-motion\/","title":{"rendered":"AI reconstructs motion sequences of humans and animals"},"content":{"rendered":"\n<p>Imagine for a moment, that we are on a safari watching a giraffe graze. After looking away for a second, we then see the animal lower its head and sit down. But, we wonder, what happened in the meantime? Computer scientists from the University of Konstanz&#8217;s Centre for the Advanced Study of Collective Behaviour have found a way to encode an animal&#8217;s pose and appearance in order to show the intermediate motions that are statistically likely to have taken place. The university outlined this technological progress in a <a href=\"https:\/\/www.campus.uni-konstanz.de\/en\/science\/neural-puppeteer\">press release<\/a>.<\/p>\n\n\n\n<p>One key problem in computer vision is that images are incredibly complex. A giraffe can take on an extremely wide range of poses. On a safari, it is usually no problem to miss part of a motion sequence, but, for the study of collective behaviour, this information can be critical. This is where computer scientists with the new model &#8220;neural puppeteer&#8221; come in.<\/p>\n\n\n<div class=\"vlp-link-container vlp-layout-basic wp-block-visual-link-preview-link advgb-dyn-45255fed\"><a href=\"https:\/\/ioplus.nl\/archive\/en\/laio\/ai-powered-drones-revolutionize-wildlife-conservation\/\" class=\"vlp-link\" title=\"AI-Powered Drones Revolutionize Wildlife Conservation\"><\/a><div class=\"vlp-layout-zone-side\"><div class=\"vlp-block-2 vlp-link-image\"><\/div><\/div><div class=\"vlp-layout-zone-main\"><div class=\"vlp-block-0 vlp-link-title\">AI-Powered Drones Revolutionize Wildlife Conservation<\/div><div class=\"vlp-block-1 vlp-link-summary\">To mark UN World Wildlife Day, EPFL research groups have developed systems that use drones equipped with AI-powered computer vision software for tracking and cataloging wildlife populations.<\/div><\/div><\/div>\n\n\n<h2 class=\"wp-block-heading\">Predictive silhouettes based on 3D points<\/h2>\n\n\n\n<p>One representation frequently used until now is the skeleton. In a new paper published in the Proceedings of the 16th Asian Conference on Computer Vision, Bastian Goldl\u00fccke and doctoral researchers Urs Waldmann and Simon Giebenhain present a neural network model that makes it possible to represent motion sequences and render full appearance of animals from any viewpoint based on just a few key points. The 3D view is more malleable and precise than the existing skeleton models.<\/p>\n\n\n\n<p>&#8220;The idea was to be able to predict 3D key points and also to be able to track them independently of texture,&#8221; says doctoral researcher Urs Waldmann. &#8220;This is why we built an AI system that predicts silhouette images from any camera perspective based on 3D key points.&#8221; By reversing the process, it is also possible to determine skeletal points from silhouette images. On the basis of the key points, the AI system is able to calculate the intermediate steps that are statistically likely. Using the individual silhouette can be important. This is because, if you only work with skeletal points, you would not otherwise know whether the animal you&#8217;re looking at is a fairly massive one, or one that is close to starvation.<\/p>\n\n\n\n<p>In the field of biology in particular, there are applications for this model: &#8220;At the Cluster of Excellence &#8216;Centre for the Advanced Study of Collective Behaviour&#8217;, we see that many different species of animals are tracked and that poses also need to be predicted in this context&#8221;, Waldmann says.<\/p>\n\n\n<div class=\"vlp-link-container vlp-layout-basic wp-block-visual-link-preview-link advgb-dyn-54638122\"><a href=\"https:\/\/ioplus.nl\/archive\/en\/laio\/new-ai-system-fights-illegal-online-wildlife-trade\/\" class=\"vlp-link\" title=\"New AI system fights illegal online wildlife trade\"><\/a><div class=\"vlp-layout-zone-side\"><div class=\"vlp-block-2 vlp-link-image\"><\/div><\/div><div class=\"vlp-layout-zone-main\"><div class=\"vlp-block-0 vlp-link-title\">New AI system fights illegal online wildlife trade<\/div><div class=\"vlp-block-1 vlp-link-summary\">Illegal wildlife trade might be hit with a considerable crackdown in the near future. In a press release, Scientists at University of Helsinki communicated that they have developed an AI method for tackling the global multi-billion dollar business of internet illegal wildlife trading.<\/div><\/div><\/div>\n\n\n<h2 class=\"wp-block-heading\">Looking to get as much data as possible on wild animals<\/h2>\n\n\n\n<p>The team started by predicting silhouette motions of humans, pigeons, giraffes and cows.&nbsp;<a href=\"https:\/\/www.youtube.com\/shorts\/RA_g1LVIe0U\">Humans<\/a>&nbsp;are often used as test cases in computer science, Waldmann notes. His colleagues from the Cluster of Excellence work with&nbsp;<a href=\"https:\/\/www.youtube.com\/watch?v=ReTyXgLpDJE\">pigeons<\/a>. However, their fine claws pose a real challenge. There was good model data for&nbsp;<a href=\"https:\/\/www.youtube.com\/watch?v=PZ_Uqp6BaPw\">cows<\/a>, while the&nbsp;<a href=\"https:\/\/www.youtube.com\/shorts\/75T3swlgtpA\">giraffe&#8217;s<\/a>&nbsp;extremely long neck was a challenge that Waldmann was eager to take on. The team generated silhouettes based on a few key points \u2013 from 19 to 33 in all.<\/p>\n\n\n\n<p>Now the computer scientists are ready for the real world application: In the University of Konstanz&#8217;s Imaging Hanger, its largest laboratory for the study of collective behaviour, data will be collected on insects and birds in the future. In the Imaging Hangar, it is easier to control environmental aspects such as lighting or background than in the wild. However, the long-term goal is to train the model for as many species of wild animals as possible, in order to gain new insight into the behaviour of animals.<\/p>\n","protected":false},"author":2583,"featured_media":492934,"template":"","meta":{"_acf_changed":false,"advgb_blocks_editor_width":"","advgb_blocks_columns_visual_guide":""},"categories":[34665,76370],"tags":[9646,10373,34961,129833,129836,33361],"location":[24456],"internal_archives":[],"class_list":["post-439456","selected","type-selected","status-publish","has-post-thumbnail","hentry","category-health","category-science","tag-3d-en","tag-ai","tag-animals","tag-motion-sequence","tag-university-of-konstanz","tag-wildlife","location-germany"],"blocksy_meta":[],"acf":[],"featured_img":"https:\/\/ioplus.nl\/archive\/wp-content\/uploads\/2023\/03\/Vis.jpg","coauthors":[],"author_meta":{"author_link":"https:\/\/ioplus.nl\/archive\/author\/francesco-morelli\/","display_name":"Francesco Morelli"},"relative_dates":{"created":"Posted 3 years ago","modified":"Updated 3 years ago"},"absolute_dates":{"created":"Posted on March 9, 2023","modified":"Updated on March 9, 2023"},"absolute_dates_time":{"created":"Posted on March 9, 2023 3:00 pm","modified":"Updated on March 9, 2023 3:00 pm"},"featured_img_caption":"","tax_additional":{"category":{"linked":["<a href=\"https:\/\/ioplus.nl\/archive\/en\/category\/health\/\" class=\"advgb-post-tax-term\">Health<\/a>","<a href=\"https:\/\/ioplus.nl\/archive\/en\/category\/science\/\" class=\"advgb-post-tax-term\">Science<\/a>"],"unlinked":["<span class=\"advgb-post-tax-term\">Health<\/span>","<span class=\"advgb-post-tax-term\">Science<\/span>"],"slug":"category","name":"Categories"},"post_tag":{"linked":["<a href=\"https:\/\/ioplus.nl\/archive\/en\/tag\/3d-en\/\" class=\"advgb-post-tax-term\">3D<\/a>","<a href=\"https:\/\/ioplus.nl\/archive\/en\/tag\/ai\/\" class=\"advgb-post-tax-term\">AI<\/a>","<a href=\"https:\/\/ioplus.nl\/archive\/en\/tag\/animals\/\" class=\"advgb-post-tax-term\">animals<\/a>","<a href=\"https:\/\/ioplus.nl\/archive\/en\/tag\/motion-sequence\/\" class=\"advgb-post-tax-term\">motion sequence<\/a>","<a href=\"https:\/\/ioplus.nl\/archive\/en\/tag\/university-of-konstanz\/\" class=\"advgb-post-tax-term\">University of Konstanz<\/a>","<a href=\"https:\/\/ioplus.nl\/archive\/en\/tag\/wildlife\/\" class=\"advgb-post-tax-term\">Wildlife<\/a>"],"unlinked":["<span class=\"advgb-post-tax-term\">3D<\/span>","<span class=\"advgb-post-tax-term\">AI<\/span>","<span class=\"advgb-post-tax-term\">animals<\/span>","<span class=\"advgb-post-tax-term\">motion sequence<\/span>","<span class=\"advgb-post-tax-term\">University of Konstanz<\/span>","<span class=\"advgb-post-tax-term\">Wildlife<\/span>"],"slug":"post_tag","name":"Tags"},"language":{"linked":["<a href=\"https:\/\/ioplus.nl\/archive\/en\/\" class=\"advgb-post-tax-term\">EN<\/a>"],"unlinked":["<span class=\"advgb-post-tax-term\">EN<\/span>"],"slug":"language","name":"Tags"},"post_translations":{"linked":["<a href=\"https:\/\/ioplus.nl\/archive\/?taxonomy=post_translations&#038;term=pll_6409e1a3ee90f\" class=\"advgb-post-tax-term\">pll_6409e1a3ee90f<\/a>"],"unlinked":["<span class=\"advgb-post-tax-term\">pll_6409e1a3ee90f<\/span>"],"slug":"post_translations","name":""},"location":{"linked":["<a href=\"https:\/\/ioplus.nl\/archive\/location\/germany\/\" class=\"advgb-post-tax-term\">Germany<\/a>"],"unlinked":["<span class=\"advgb-post-tax-term\">Germany<\/span>"],"slug":"location","name":"Locations"},"internal_archives":{"linked":[],"unlinked":[],"slug":"internal_archives","name":"Internal Archives"}},"series_order":"","_links":{"self":[{"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/selected\/439456","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/selected"}],"about":[{"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/types\/selected"}],"author":[{"embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/users\/2583"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/media\/492934"}],"wp:attachment":[{"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/media?parent=439456"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/categories?post=439456"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/tags?post=439456"},{"taxonomy":"location","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/location?post=439456"},{"taxonomy":"internal_archives","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/internal_archives?post=439456"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}