Facebook, now Meta Platforms, has revolutionized how people connect and share information worldwide. However, this powerful platform has also been implicated in facilitating global extremism, including ethnic cleansing and human trafficking. This article delves into Facebook’s role in these issues, examining how the platform has been used to promote extremist agendas, incite violence, and exploit vulnerable populations. We will also explore the measures Facebook has taken to address these challenges and the criticisms it has faced in its efforts to combat extremism.
Extremist groups have exploited Facebook’s vast reach and features to spread propaganda, recruit members, and incite violence1. One way this occurs is through the creation of Facebook groups and pages that provide a platform for extremists to share information, videos, and other propaganda, effectively radicalizing a wider audience1. A report by the Institute for Volunteerism Research (IVolunteer) found that nearly two-thirds of extremists used Facebook to communicate their views and encourage action between 2005 and 20162. The FBI has also compared the spread of extremism on social media to foreign disinformation campaigns2.
Furthermore, Facebook’s chat function can be used by extremists to exchange private messages and coordinate attacks in real-time1. This highlights the platform’s potential for facilitating not only online radicalization but also the planning and execution of extremist activities.
Facebook’s algorithms, designed to maximize user engagement, can inadvertently contribute to the spread of extremist content3. By prioritizing content that evokes strong emotions, the platform can create “filter bubbles” and echo chambers where extremist views are amplified and reinforced3. This can lead to increased polarization and the normalization of extremist ideologies3.
Moreover, Facebook’s business model, which prioritizes engagement, may inadvertently incentivize the spread of extremist content3. As the platform profits from increased user interaction, there is a risk that algorithms may prioritize content that generates strong emotional responses, even if that content is harmful or promotes extremist views.
Furthermore, Facebook’s auto-generation of pages has been found to promote extremist content. In some cases, the platform has automatically created pages for terrorist organizations and white supremacist groups, effectively providing them with a platform to spread their message4.
Facebook has been particularly scrutinized for its role in ethnic cleansing, notably in Myanmar. The platform’s algorithms and lack of adequate content moderation contributed to the spread of hate speech and incitement to violence against the Rohingya Muslim minority5. Amnesty International reports that Facebook’s pursuit of profit, coupled with its algorithms, created an echo chamber that fueled hatred towards the Rohingya and contributed to their mass displacement5. This highlights how the platform’s design, intended to increase user engagement, can have unintended and harmful consequences in the context of ethnic conflict.
One of the most concerning aspects of Facebook’s role in Myanmar was its failure to act despite warnings6. Even when alerted to the escalating violence and hate speech on its platform, the company did not take sufficient measures to prevent the spread of harmful content6. This inaction had devastating consequences for the Rohingya population6.
Facebook has also been criticized for its handling of ethnic violence in Ethiopia7. Despite warnings from its partners in Kenya, the platform failed to adequately address hate speech and incitement to violence, contributing to social and political polarization7.
Beyond its role in ethnic cleansing, Facebook has also been implicated in facilitating human trafficking, another form of exploitation that thrives on online platforms. Traffickers exploit the platform to identify and recruit victims, often by leveraging personal information shared online8. They use social media to gain insights into individuals’ lives, identify vulnerabilities, and groom potential victims by offering empathy and support8. Traffickers may establish online relationships with victims on Facebook to lure them into potentially dangerous situations9.
A 2020 study of 133 sex trafficking cases found that 59% of survivors were recruited on Facebook10. The National Human Trafficking Hotline in the United States reported a 125% increase in reports of recruitment into trafficking through Facebook between 2019 and 20208. While Facebook is the most popular platform for online recruitment of trafficking victims, the problem extends to other social media platforms as well8.
It is important to note that while Facebook can be a tool for traffickers, it can also be a source of support for survivors. Some survivors of human trafficking have used social media, including Facebook groups, to connect with allies and advocates and find help10. This demonstrates the complex and multifaceted nature of social media’s role in human trafficking.
The platform’s end-to-end encryption has also raised concerns among child protection organizations12. While intended to enhance privacy, encryption can make it more difficult to detect and prevent child exploitation and trafficking12.
Facebook has implemented various measures to prevent its platform from being used to promote extremism. These include:
In response to growing concerns, Facebook has implemented various measures to combat extremism on its platform. These include:
| Measure | Description |
|---|---|
| Content Moderation | Facebook has invested in content moderation systems that use artificial intelligence and human reviewers to identify and remove extremist content4. For example, AI can be used to detect hate speech, while human reviewers assess more complex cases. They have also updated their community standards to address extremist content more effectively14. |
| Transparency Center | Facebook launched a Transparency Center in May 2021 to provide more information about its content moderation policies and practices14. This aims to increase accountability and provide users with a better understanding of how content is moderated on the platform. |
| Partnerships | Facebook collaborates with civil society organizations and media outlets to evaluate content and identify potential risks15. These partnerships help Facebook access expertise and local knowledge to better understand and address extremist content in different contexts. |
| Counter-Narratives | Facebook supports initiatives that promote counter-narratives to extremist ideologies2. This involves working with organizations and individuals to create and disseminate content that challenges extremist views and promotes tolerance and understanding. |
| User Education | Facebook provides resources to educate users about online safety and how to identify inaccurate content2. This includes providing tips on how to spot fake news, identify online scams, and report harmful content. |
Despite these efforts, Facebook continues to face challenges in effectively addressing extremism. The sheer volume of content on the platform makes it difficult to moderate effectively, and extremist groups often employ sophisticated tactics to circumvent detection14.
Experts and organizations have raised various criticisms and concerns regarding Facebook’s handling of extremism. These include:
Facebook’s role in global extremism is a complex issue with no easy solutions. While the platform has taken steps to address the problem, concerns remain about its effectiveness and commitment to combating extremism. Facebook’s emphasis on user engagement, coupled with its algorithmic design and limitations in content moderation, has created an environment where extremist content can flourish. This has contributed to real-world harms, including ethnic cleansing and human trafficking.
The potential long-term consequences of Facebook’s role in extremism are significant. The platform’s reach and influence mean that its failure to adequately address extremism can have far-reaching impacts on individuals, communities, and societies. This raises broader questions about the responsibilities of online platforms in preventing the spread of harmful content and protecting vulnerable populations.
Moving forward, Facebook needs to prioritize user safety and invest in more robust content moderation systems. This includes greater transparency, increased resources for content moderation, and a more proactive approach to identifying and addressing extremist content. Addressing these challenges is crucial to ensuring that Facebook does not become a tool for promoting violence and exploitation.
Furthermore, greater collaboration between tech companies, governments, and civil society organizations is needed to address this complex issue. By working together, these stakeholders can develop more effective strategies to prevent extremism online and mitigate the harms associated with it.
1. Facebook and Violent Extremism - International Association of Chiefs of Police, accessed on January 8, 2025, https://www.theiacp.org/sites/default/files/2018-07/FacebookAwarenessBrief.pdf
2. Social Media and Political Extremism | VCU HSEP, accessed on January 8, 2025, https://onlinewilder.vcu.edu/blog/political-extremism/
3. Facebook’s ethical failures are not accidental; they are part of the business model - PMC, accessed on January 8, 2025, https://pmc.ncbi.nlm.nih.gov/articles/PMC8179701/
4. Stop Terror and Hate Content on Facebook - National Whistleblower Center, accessed on January 8, 2025, https://www.whistleblowers.org/whistleblower-petition-to-sec-facebook-is-misleading-shareholders-about-terror-and-hate-content-on-its-website/
5. Myanmar: Time for Meta to pay reparations to Rohingya for role in ethnic cleansing, accessed on January 8, 2025, https://www.amnesty.org/en/latest/news/2023/08/myanmar-time-for-meta-to-pay-reparations-to-rohingya-for-role-in-ethnic-cleansing/
6. Myanmar: Facebook’s systems promoted violence against Rohingya; Meta owes reparations – new report - Amnesty International, accessed on January 8, 2025, https://www.amnesty.org/en/latest/news/2022/09/myanmar-facebooks-systems-promoted-violence-against-rohingya-meta-owes-reparations-new-report/
7. “The Road to Hell is Paved with Good Intentions”: the Role of Facebook in Fuelling Ethnic Violence - Annenberg School for Communication - University of Pennsylvania, accessed on January 8, 2025, https://www.asc.upenn.edu/research/centers/milton-wolf-seminar-media-and-diplomacy/blog/road-hell-paved-good-intentions-role-facebook-fuelling-ethnic-violence
8. Technology’s Complicated Relationship with Human Trafficking, accessed on January 8, 2025, https://www.acf.hhs.gov/blog/2022/07/technologys-complicated-relationship-human-trafficking
9. Social Media & Human Trafficking | Social Media Victims Law Center, accessed on January 8, 2025, https://socialmediavictims.org/sexual-violence/human-trafficking/
10. Human trafficking and social media - The Exodus Road, accessed on January 8, 2025, https://theexodusroad.com/human-trafficking-and-social-media/
11. Over half of online recruitment in active sex trafficking cases last year occurred on Facebook, report says - CBS News, accessed on January 8, 2025, https://www.cbsnews.com/news/facebook-sex-trafficking-online-recruitment-report/
12. Meta/Facebook Platforms Enable Child Sex Trafficking and …, accessed on January 8, 2025, https://www.iccr.org/metafacebook-platforms-enable-child-sex-trafficking-and-exploitation-say-shareholders/
13. Chapter 12 Prevention of Radicalization on Social Media and the Internet - International Centre for Counter-Terrorism, accessed on January 8, 2025, https://icct.nl/sites/default/files/2023-01/Chapter-12-Handbook_0.pdf
14. Facebook’s policies against extremism: Ten years of struggle for more transparency, accessed on January 8, 2025, https://firstmonday.org/ojs/index.php/fm/article/download/11705/10210
15. What Facebook Does (and Doesn’t) Have to Do with Ethiopia’s Ethnic Violence, accessed on January 8, 2025, https://www.crisisgroup.org/africa/horn-africa/ethiopia/what-facebook-does-and-doesnt-have-do-ethiopias-ethnic-violence