{"id":484902,"date":"2024-08-10T08:40:00","date_gmt":"2024-08-10T06:40:00","guid":{"rendered":"https:\/\/innovationorigins.com\/?p=484902"},"modified":"2024-08-10T08:40:00","modified_gmt":"2024-08-10T06:40:00","slug":"stranger-danger-and-online-fringe-communities","status":"publish","type":"post","link":"https:\/\/ioplus.nl\/archive\/en\/stranger-danger-and-online-fringe-communities\/","title":{"rendered":"Stranger Danger and online fringe communities"},"content":{"rendered":"\n

New EPFL research<\/a> has found that the exchange of comments between members and non-members of fringe communities (“fringe interactions”) on mainstream online platforms attracts new members to these groups. It has also suggested potential ways to curtail this growth.<\/p>\n\n\n\n

Fringe communities promoting conspiracy theories and extremist ideologies have thrived on mainstream online platforms, consistently raising the question on how this growth is fueled. Now, researchers in EPFL\u2019s School of Computer and Communication Sciences<\/a> (IC) studying this phenomenon have found what they believe to be a possible mechanism supporting this growth.<\/p>\n\n\n\n

In their paper, Stranger Danger! Cross-Community Interactions with Fringe Users Increase the Growth of Fringe Communities on Reddit<\/a>, which recently won the Best Paper Award at the 18th International AAAI Conference on Web and Social Media (ICWSM), scientists from the Data Science Laboratory (DLAB) have outlined fringe-interactions \u2013 the exchange of comments between members and non-members of fringe communities. Applying text-based causal inference techniques to study the impact of fringe interactions on the growth of fringe communities, the researchers focused on three prominent groups on Reddit: r\/Incel, r\/GenderCritical, and r\/The Donald.<\/p>\n\n\n\n

Growth drivers<\/h2>\n\n\n\n

\u201cIt\u2019s well known that there are fringe communities on the big online social platforms and equally known that these platforms try to moderate them; however, even with moderation, these communities keep growing. So, we wondered what else could be driving this growth?\u2019 explained Giuseppe Russo, a postdoctoral researcher in DLAB.<\/p>\n\n\n\n

\u201cWe found that fringe-interactions \u2013 basically entailing an exchange of comments between a \u2018vulnerable user\u2019 and a user already active in a fringe community \u2013 were bringing people on the edge towards these groups. And the comments aren\u2019t obvious, like \u2018join my community\u2019 they are topical discussions that attract the attention of other people and a clever way to skip moderation policies,\u201d he continued.<\/p>\n\n\n\n

Users who received these interactions were up to 4.2 percentage points more likely to join fringe communities than similar, matched users who did not. This effect was influenced by the characteristics of communities where the interaction happens (e.g., left vs. right-leaning communities) and the language used in the interactions. Toxic language had a 5 percentage point higher chance of attracting newcomers to fringe communities than non-toxic interactions.<\/p>\n\n\n\n

Intended strategy<\/h2>\n\n\n\n

Once a vulnerable user had engaged in an exchange of comments, finding a fringe community online was just a click away, as every user profile immediately shows the groups in which someone has been active. The researchers also found that this recruitment method is unique to fringe communities \u2013 they didn\u2019t find it occurring in climate, gaming, sporting or other communities \u2013 supporting the hypothesis that this could be an intended strategy.<\/p>\n\n\n\n

\u201cThe recruitment mechanism is very simple, it\u2019s literally just one exchange of comments. One small discussion is enough to drive vulnerable users towards these bad communities and once they are there, many previous studies have shown that they radicalize and become active members of these extremist communities,\u201d said Russo.<\/p>\n\n\n\n

The research results raise important questions \u2013 is this recruitment mechanism relevant enough to warrant the attention of online platforms\u2019 moderation policies and, if yes, how can we stop it from helping fuel the growth of these communities?<\/p>\n\n\n\n

Reducing visibility<\/h2>\n\n\n\n

Based on the observational period considered the researchers estimate approximately 7.2%, 3.1% and 2.3% of users that joined r\/Incels, r\/GenderCritical, and r\/TheDonald respectively, did so after interacting with members of those groups. They say that this suggests that community-level moderation policies could be combined with sanctions applied to individual users, for example, reducing the visibility of their posts or limiting the number of comments they can make in more susceptible communities. The researchers believe that these measures may diminish the impact of fringe-interactions and slow down the growth of fringe communities on mainstream platforms.<\/p>\n\n\n\n

\u201cFrom a societal perspective, I think this is extremely relevant for many reasons, one of which is that we have seen that the impact of these fringe communities is not exclusively online, there is an offline impact too. We have seen riots and terrorism, we have seen women targeted and killed by members of these communities, so by reducing access to these communities we definitely reduce the risk offline which is what we really care about in the end,\u201d concluded Russo.<\/p>\n","protected":false},"excerpt":{"rendered":"

New EPFL research has found that the exchange of comments between members and non-members of fringe communities (“fringe interactions”) on mainstream online platforms attracts new members to these groups. It has also suggested potential ways to curtail this growth. Fringe communities promoting conspiracy theories and extremist ideologies have thrived on mainstream online platforms, consistently raising […]<\/p>\n","protected":false},"author":2589,"featured_media":505982,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"advgb_blocks_editor_width":"","advgb_blocks_columns_visual_guide":"","footnotes":""},"categories":[84026,8553],"tags":[39636,85743],"location":[52892],"article_type":[36684],"serie":[],"archives":[],"internal_archives":[],"reboot-archive":[82795],"class_list":["post-484902","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data","category-digital","tag-epfl-en","tag-fringe-communities","location-switzerland","article_type-news","reboot-archive-data"],"blocksy_meta":[],"acf":{"subtitle":"EPFL researchers found that fringe-interactions \u2013 between a \u2018vulnerable user\u2019 and a user already active in a fringe community \u2013 were bringing people on the edge towards these groups.","text_display_homepage":false},"author_meta":{"display_name":"Team IO","author_link":"https:\/\/ioplus.nl\/archive\/author\/erikdevries\/"},"featured_img":"https:\/\/ioplus.nl\/archive\/wp-content\/uploads\/2024\/04\/brewbart_someone_using_social_media_to_share_a_useless_opinion__4549f906-2fa6-49ee-b5f9-ac1a4e53fd54.png","coauthors":[],"tax_additional":{"categories":{"linked":["DATA+<\/a>","Digital<\/a>"],"unlinked":["DATA+<\/span>","Digital<\/span>"]},"tags":{"linked":["EPFL<\/a>","Fringe communities<\/a>"],"unlinked":["EPFL<\/span>","Fringe communities<\/span>"]}},"comment_count":"0","relative_dates":{"created":"Posted 2 years ago","modified":"Updated 2 years ago"},"absolute_dates":{"created":"Posted on August 10, 2024","modified":"Updated on August 10, 2024"},"absolute_dates_time":{"created":"Posted on August 10, 2024 8:40 am","modified":"Updated on August 10, 2024 8:40 am"},"featured_img_caption":"","series_order":"","_links":{"self":[{"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/posts\/484902","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/users\/2589"}],"replies":[{"embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/comments?post=484902"}],"version-history":[{"count":0,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/posts\/484902\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/media\/505982"}],"wp:attachment":[{"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/media?parent=484902"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/categories?post=484902"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/tags?post=484902"},{"taxonomy":"location","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/location?post=484902"},{"taxonomy":"article_type","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/article_type?post=484902"},{"taxonomy":"serie","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/serie?post=484902"},{"taxonomy":"archives","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/archives?post=484902"},{"taxonomy":"internal_archives","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/internal_archives?post=484902"},{"taxonomy":"reboot-archive","embeddable":true,"href":"https:\/\/ioplus.nl\/archive\/wp-json\/wp\/v2\/reboot-archive?post=484902"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}