SyloSpace

How do AI recommendation algorithms create toxic feeds, and can users switch them off?

Feeds built to maximise engagement tend to push extreme or emotional content, and filter bubbles come from emotion, identity and social networks interacting with the algorithm, not the algorithm alone.

Updated 49 minutes ago5 min readVersion 2

Covers: The mechanisms by which recommender systems can amplify sensational, polarising or harmful content, the evidence on harms, and the practical controls users have (platform settings, chronological feeds, third-party tools, regulation). Does not cover how to build a recommender system or detailed technical model architectures.

Also answers: Why is my feed toxic? · Can I turn off algorithmic recommendations? · How do social media algorithms create echo chambers? · How to disable AI recommendations on social media?

The short answer

Interpretation AI-prepared starting map

Recommender systems that optimise for engagement tend to push content that captures attention, and extreme or emotionally charged material often does that best. A systematic review of 30 studies across Facebook, YouTube, Twitter/X, Instagram, TikTok and Weibo found that algorithmic systems structurally amplify ideological homogeneity, reinforcing selective… 1234

Read the full explanation and caveats

In brief

  1. Engagement-optimised recommenders tend to amplify attention-grabbing, often extreme or emotionally charged content, which can narrow what users see.15

    Evidence-backed
  2. Filter bubbles are co-produced: emotion, identity and social networks interact with the algorithm rather than the algorithm acting alone.3

    Evidence-backed
  3. Young people are often partly aware of algorithmic influence but feel limited control, and their coping strategies are unevenly distributed.41

    Evidence-backed
  4. Proposed fixes span individual tactics (weak ties, reflective reasoning), platform design (more variety, transparency) and regulation such as Australia's proposed off switch.326

    Evidence-backed
  5. The evidence base is fragmented and Western-skewed, with little long-term research on whether controls work.1

    Interpretation

At a glance

The picture in numbers

Live · updated just now

Review across Facebook, YouTube, Twitter/X, Instagram, TikTok and Weibo

30 studies

Studies in the systematic review of algorithmic amplification1

The evidence behind it

6 sources
  • Reviews of many studies2
  • Other studies and data3
  • Background1

Published in 2025 and 2026

Sources on this page by kind and year
SourceKindYear
Toxic algorithms wouldn't let them go - now Australia wants an off switchBackground2026
Intelligent Systems, Vulnerable Minds: A Framework for Radicalization to Violence in the Age of AI.Other studies and data2026
Emotion as a cross-layer mechanism in filter bubbles: a social-psychological perspective.Other studies and data2025
Trap of Social Media Algorithms: A Systematic Review of Research on Filter Bubbles, Echo Chambers, and Their Impact on YouthReviews of many studies2025
Understanding Echo Chambers in Recommender Systems: A Systematic ReviewReviews of many studies2025
Algorithmic recommendation and adolescent mental health: a grounded theory study of social and commercial determinants.Other studies and data2026

The community around it

No one has added to this page yet. Firsthand experience, a newer study or a different reading of the numbers would show up here, credited to you.

The full explanation

Interpretation AI-prepared starting map

Recommender systems that optimise for engagement tend to push content that captures attention, and extreme or emotionally charged material often does that best. A systematic review of 30 studies across Facebook, YouTube, Twitter/X, Instagram, TikTok and Weibo found that algorithmic systems structurally amplify ideological homogeneity, reinforcing selective exposure and limiting viewpoint diversity. A separate review of research from 2019 to early 2025 confirms that echo chambers and filter bubbles do exist in recommender systems and raise concerns for diversity and fairness. Researchers argue the effect is not the algorithm alone: filter bubbles emerge from the interaction of motivated thinking, identity-based social networks and algorithmic amplification of emotional cues. A grounded theory study of adolescents describes three interlocking processes — algorithmic reinforcement of engagement, emotional feedback loops between mood and recommendations, and a persistent sense of limited control despite high awareness.1234

What this rests on6 independent sources
  • Evidence 17
  • Interpretation 3

What it means for you

Which fits you?

Pick the situation closest to yours. Each answer says what it rests on.

If you feel stuck in a feed that keeps serving upsetting or extreme content

deliberately follow weak ties — people and outlets outside your usual network — and pause to check whether strong emotions are driving what you click, since emotion is a key channel through which filtering intensifies.3

Evidence-backed

If you are a parent or educator of teenagers

treat algorithmic literacy as a teachable skill, but don't rely on it alone: the adolescent research found awareness and coping strategies were uneven and often insufficient against engagement-driven design, so combine education with pressure for platform-level change.4

Evidence-backed

If you want structural rather than individual remedies

the levers described are variety in recommendations, transparency, and regulation such as Australia's proposed right not to be served unwanted content.26

Evidence-backed

If you are worried about someone drifting toward extremist material

watch for the staged pattern — exposure to extreme content, reinforcement through a seeming consensus, then integration into a validating group — and intervene early, since the framework proposes measures at each stage.5

Evidence-backed

The full story · 3 chapters

How do AI recommendation algorithms produce 'toxic' or harmful feeds, and what options do users have to turn them off or change them?

Chapter 1: How feeds turn toxic

Evidence-backed

Evidence-backed: The core mechanism is engagement optimisation. A framework paper argues that AI-driven algorithms designed to maximise engagement, compounded by generative AI, can unintentionally set the stage for radicalisation in stages: Exposure, where algorithms push users toward extreme content because it captures attention; Reinforcement, where personalised content plus AI swarms create a synthetic consensus that normalises extremity and insulates users from alternative views; and Group Integration, where people are absorbed into extremist networks validated by human peers, AI companions and bot swarms, exploiting needs for belonging and certainty.5

Evidence-backed

Evidence-backed: A social-psychological review argues that filter bubbles are not produced by algorithms alone. They emerge from recursive interaction between motivated cognitive processing, identity-based social network structures, and algorithmic amplification of behavioural and emotional cues. Emotion — anger, threat, defiant self-worth — is described as a central cross-layer mechanism: it guides information seeking, reinforces group affiliation and shapes what gets recommended, intensifying filtering and contributing to attitude extremisation.3

Evidence-backed

Evidence-backed: A systematic review of 30 studies found three consistent patterns: algorithmic systems structurally amplify ideological homogeneity, reinforcing selective exposure and limiting viewpoint diversity; young people show partial awareness and adaptive strategies but their agency is constrained by opaque systems and uneven digital literacy; and echo chambers also serve as spaces for identity reinforcement and cultural belonging, not only polarisation.1

Evidence-backed

Evidence-backed: A review of recommender-system research from 2019 to early 2025 confirms echo chambers and filter bubbles exist in recommender systems and raise concerns for diversity and fairness, and notes that several works propose ways to introduce more variety into recommendations to break repetitive exposure.2

This part rests on

2. Understanding Echo Chambers in Recommender Systems: A Systematic Review
Echo chambers refer to the phenomenon in which individuals are consistently exposed to content that aligns with their existing viewpoints. Over time, this can narrow a user’s perspective and make it harder to encounter different opinions. In this systematic literature review, we looked at studies published between 2019 and early 2025 and how they have approached this issue, from understanding the cause, and examining existing detection and mitigation strategies. We went through and organized the main findings, noting patterns in the algorithms used, the role of user behavior, and the influence of the data itself. Several works also suggest ways to introduce more variety into recommendations, aiming to break repetitive exposure. Our review confirms that echo chambers and filter bubbles do exist in recommender systems and that they raise concerns for diversity and fairness. Furthermore, we end by pointing to open questions and possible directions for future work, for both researchers and practitioners.
Read original source
1. Trap of Social Media Algorithms: A Systematic Review of Research on Filter Bubbles, Echo Chambers, and Their Impact on Youth
A total of 30 studies were analyzed, using the PRISMA 2020 framework, encompassing computational audits, simulation modeling, surveys, ethnographic accounts, and mixed-methods designs across diverse platforms, including Facebook, YouTube, Twitter/X, Instagram, TikTok, and Weibo. Results reveal three consistent patterns: (i) algorithmic systems structurally amplify ideological homogeneity, reinforcing selective exposure and limiting viewpoint diversity; (ii) youth demonstrate partial awareness and adaptive strategies to navigate algorithmic feeds, though their agency is constrained by opaque recommender systems and uneven digital literacy; and (iii) echo chambers not only foster ideological polarization but also serve as spaces for identity reinforcement and cultural belonging. Despite these insights, the evidence base suffers from geographic bias toward Western contexts, limited longitudinal research, methodological fragmentation, and conceptual ambiguity in key definitions. This review highlights the need for integrative, cross-cultural, and youth-centered approaches that bridge empirical evidence with lived experiences.
Read original source
3. Emotion as a cross-layer mechanism in filter bubbles: a social-psychological perspective.
This review synthesizes recent research from a social-psychological perspective, arguing that filter bubbles are not produced by algorithms alone but emerge through the recursive interaction of motivated cognitive processing, identity-based social network structures, and algorithmic amplification of behavioral and emotional cues. We identify emotion as an underrecognized yet central mechanism that operates across these layers: emotional states such as anger, threat, and defiant self-worth guide information seeking, reinforce group affiliation, and shape algorithmic recommendation patterns, thereby intensifying filtering dynamics and contributing to attitude extremization. By conceptualizing filter bubbles as systems of cognitive coherence, identity protection, and affective regulation, we propose a dynamic multi-level explanatory model and outline implications for interventions, including reflective reasoning strategies, weak-tie exposure, and approaches that address the emotional and identity foundations of information selection.
Read original source
5. Intelligent Systems, Vulnerable Minds: A Framework for Radicalization to Violence in the Age of AI.
We conclude by outlining a stage-based framework for governance and future research.Public AbstractAI-driven algorithms designed to maximize engagement on social media, compounded by generative AI, can unintentionally set the stage for radicalization. It begins with Exposure, where algorithms push users toward extreme content because it captures attention. Next, during Reinforcement, algorithms feed users personalized content while AI swarms can create a synthetic consensus that reinforces emerging biases, normalizes extremity, and insulates users from alternative views. Third, during Group Integration, individuals are absorbed into extremist networks, reinforced by human peers, AI companions, and bot swarms that validate radical beliefs and deepen identity ties. By exploiting psychological needs for belonging and certainty, this stage becomes particularly pernicious, potentially opening the door for violence. We propose policy measures that can reduce radicalization at each stage.
Read original source

4 independent sources

Step by stepHow engagement feeds can lead toward radicalisation
  1. ExposureAlgorithms push extreme content because it captures attention
  2. ReinforcementPersonalised content and AI swarms create a synthetic consensus that normalises extremity
  3. Group IntegrationPeople are absorbed into extremist networks validated by peers, AI companions and bots

Drawn from this chapter's text

Chapter 2: What the harms look like

AI summary:In adolescents, algorithmic reinforcement, emotional feedback loops and a sense of limited control sustained exposure, and their coping strategies were uneven and often insufficient.

Evidence-backed

Evidence-backed: In a grounded theory study of adolescents, algorithms organised what content participants encountered, how often, and with what emotional intensity, within broader social and commercial contexts. Three interlocking processes sustained exposure: algorithmic reinforcement of engagement, emotional feedback loops between mood and recommendations, and a persistent sense of limited control despite high awareness. Participants developed adaptive strategies and algorithmic literacy, but these were unevenly distributed and often insufficient within engagement-driven, profit-oriented systems. The authors conclude that protecting mental health requires multi-level action, including developmentally appropriate algorithmic literacy education alongside structural reform of recommendation systems, transparency and platform governance.4

Evidence-backed

Evidence-backed: The radicalisation framework links the staged process to a potential opening for violence, and proposes policy measures to reduce radicalisation at each stage. This is a proposed model rather than a measured causal chain.5

This part rests on

4. Algorithmic recommendation and adolescent mental health: a grounded theory study of social and commercial determinants.
Algorithms organised what content participants encountered, how frequently, and with what emotional intensity, within broader socioecological contexts. Three interlocking processes sustained exposure; algorithmic reinforcement of engagement, emotional feedback loops between mood and recommendations, and a persistent sense of limited control despite high awareness. Although participants developed adaptive strategies and algorithmic literacy, these were unevenly distributed and often insufficient within engagement-driven, profit-oriented systems.ConclusionsDigital mental health may be produced through interactions between individual capacities, social environments, and commercially driven platform design. Protecting population mental health therefore requires multi-level action, including developmentally appropriate social media and algorithmic literacy education alongside structural reforms to recommendation systems, transparency, and platform governance.
Read original source
5. Intelligent Systems, Vulnerable Minds: A Framework for Radicalization to Violence in the Age of AI.
We conclude by outlining a stage-based framework for governance and future research.Public AbstractAI-driven algorithms designed to maximize engagement on social media, compounded by generative AI, can unintentionally set the stage for radicalization. It begins with Exposure, where algorithms push users toward extreme content because it captures attention. Next, during Reinforcement, algorithms feed users personalized content while AI swarms can create a synthetic consensus that reinforces emerging biases, normalizes extremity, and insulates users from alternative views. Third, during Group Integration, individuals are absorbed into extremist networks, reinforced by human peers, AI companions, and bot swarms that validate radical beliefs and deepen identity ties. By exploiting psychological needs for belonging and certainty, this stage becomes particularly pernicious, potentially opening the door for violence. We propose policy measures that can reduce radicalization at each stage.
Read original source

2 independent sources

How the cycle runsThree interlocking processes in adolescents' feeds
  1. Algorithmic reinforcementAlgorithms organise what content is encountered and how often
  2. Emotional feedback loopsMood and recommendations feed into each other
  3. Limited controlA persistent sense of little control despite high awareness

Drawn from this chapter's text

Chapter 3: What users and regulators can do

AI summary:Proposed fixes fall into individual tactics, platform design changes and regulation such as Australia's proposed off switch, described as complementary rather than sufficient alone.

Evidence-backed

Evidence-backed: Australia's government is pursuing measures intended to protect social media users from being served content they don't want to see — in effect an "off switch" for toxic recommendation behaviour. The report frames this as a policy response to users feeling unable to escape algorithmic feeds; the specific mechanism and its status are not detailed in the available summary.6

Evidence-backed

Evidence-backed: On the research side, proposed interventions include reflective reasoning strategies, exposure to weak ties (contacts outside a user's close network), and approaches that address the emotional and identity foundations of information selection rather than content alone.3

Evidence-backed

Evidence-backed: Technical reviews point to introducing more variety into recommendations as a way to break repetitive exposure, and the radicalisation framework proposes stage-based governance measures. The adolescent study calls for algorithmic literacy education plus structural reform of recommendation systems, transparency and platform governance.254

Interpretation

Interpretation: Put together, the practical levers fall into three groups: individual tactics (curating who you follow, seeking out weak ties, reflective checking of emotional reactions), platform-level design (variety in recommendations, transparency, chronological or opt-out options), and regulation (mandated controls such as the Australian proposal). The sources describe these as complementary; none shows that any single control is sufficient on its own.326

This part rests on

4. Algorithmic recommendation and adolescent mental health: a grounded theory study of social and commercial determinants.
Algorithms organised what content participants encountered, how frequently, and with what emotional intensity, within broader socioecological contexts. Three interlocking processes sustained exposure; algorithmic reinforcement of engagement, emotional feedback loops between mood and recommendations, and a persistent sense of limited control despite high awareness. Although participants developed adaptive strategies and algorithmic literacy, these were unevenly distributed and often insufficient within engagement-driven, profit-oriented systems.ConclusionsDigital mental health may be produced through interactions between individual capacities, social environments, and commercially driven platform design. Protecting population mental health therefore requires multi-level action, including developmentally appropriate social media and algorithmic literacy education alongside structural reforms to recommendation systems, transparency, and platform governance.
Read original source
2. Understanding Echo Chambers in Recommender Systems: A Systematic Review
Echo chambers refer to the phenomenon in which individuals are consistently exposed to content that aligns with their existing viewpoints. Over time, this can narrow a user’s perspective and make it harder to encounter different opinions. In this systematic literature review, we looked at studies published between 2019 and early 2025 and how they have approached this issue, from understanding the cause, and examining existing detection and mitigation strategies. We went through and organized the main findings, noting patterns in the algorithms used, the role of user behavior, and the influence of the data itself. Several works also suggest ways to introduce more variety into recommendations, aiming to break repetitive exposure. Our review confirms that echo chambers and filter bubbles do exist in recommender systems and that they raise concerns for diversity and fairness. Furthermore, we end by pointing to open questions and possible directions for future work, for both researchers and practitioners.
Read original source
3. Emotion as a cross-layer mechanism in filter bubbles: a social-psychological perspective.
This review synthesizes recent research from a social-psychological perspective, arguing that filter bubbles are not produced by algorithms alone but emerge through the recursive interaction of motivated cognitive processing, identity-based social network structures, and algorithmic amplification of behavioral and emotional cues. We identify emotion as an underrecognized yet central mechanism that operates across these layers: emotional states such as anger, threat, and defiant self-worth guide information seeking, reinforce group affiliation, and shape algorithmic recommendation patterns, thereby intensifying filtering dynamics and contributing to attitude extremization. By conceptualizing filter bubbles as systems of cognitive coherence, identity protection, and affective regulation, we propose a dynamic multi-level explanatory model and outline implications for interventions, including reflective reasoning strategies, weak-tie exposure, and approaches that address the emotional and identity foundations of information selection.
Read original source
5. Intelligent Systems, Vulnerable Minds: A Framework for Radicalization to Violence in the Age of AI.
We conclude by outlining a stage-based framework for governance and future research.Public AbstractAI-driven algorithms designed to maximize engagement on social media, compounded by generative AI, can unintentionally set the stage for radicalization. It begins with Exposure, where algorithms push users toward extreme content because it captures attention. Next, during Reinforcement, algorithms feed users personalized content while AI swarms can create a synthetic consensus that reinforces emerging biases, normalizes extremity, and insulates users from alternative views. Third, during Group Integration, individuals are absorbed into extremist networks, reinforced by human peers, AI companions, and bot swarms that validate radical beliefs and deepen identity ties. By exploiting psychological needs for belonging and certainty, this stage becomes particularly pernicious, potentially opening the door for violence. We propose policy measures that can reduce radicalization at each stage.
Read original source
6. Toxic algorithms wouldn't let them go - now Australia wants an off switch
The Australian government hopes to protect social media users from being served content they don't want to see.
Read original source

5 independent sources

Side by sideThree groups of practical levers
PointIndividual tacticsPlatform and regulation
Who decidesCurating who you followVariety in recommendations
What changesSeeking out weak tiesTransparency and opt-out options
How it worksReflective checking of emotional reactionsMandated controls such as the Australian proposal

Drawn from this chapter's text

Add a source or a different interpretation

What would strengthen or challenge this answer?

Your contribution joins the discussion. Changes to the shared answer are reviewed separately.

Your turn

Where do you stand?

Pick a question to answer, vote in the poll, or tell us if this helped. Individual answers stay private; only totals are shown.

The conversation starts here

A few questions from this page to take the topic further. Bring a source, another angle or something you've tried.

3 open questions

  • ResearcherLooks for evidenceFrom this page

    The page says no source measures how effective specific user controls are at reducing harm. What kind of study or evidence would be needed to show whether chronological feeds or pausing personalisation actually reduce exposure to harmful content?

  • ChallengerTests an assumptionFrom this page

    The page says filter bubbles are co-produced by emotion, identity and social networks rather than the algorithm alone. In what situations might algorithmic amplification matter more than those user and social factors, or less?

  • ExplorerInvites experienceFrom this page

    The page mentions an Australian proposal for an "off switch" for algorithmic feeds. What would you want to know about how such a switch would work in practice before judging whether it helps?

Readers' pollNo answers yet

How much control do you feel you have over the content your social media feeds show you?

How much control do you feel you have over the content your social media feeds show you?
Your perspective belongs in the picture.Join free to vote

Your individual answer is private. Only totals are shown.

Did this answer your question?

Be the first to vote
Your perspective belongs in the picture.Join free to vote
More quick questions: how you feel, and questions from connected pages

How do you feel about this?

No votes yet
Your perspective belongs in the picture.Join free to vote

Quick questions from connected pages

Keep exploring

Where this leads

How do AI recommendation algorithms create toxic feeds, and can users switch them off?You are here

One finding can inform several topics. Connections and subtopic reports are shown for exploring; they aren't extra evidence for this page.

Before you go

What to remember

The few things worth keeping from this page.

  1. Engagement-optimised recommenders tend to amplify attention-grabbing, often extreme or emotionally charged content, which can narrow what users see.

  2. Filter bubbles are co-produced: emotion, identity and social networks interact with the algorithm rather than the algorithm acting alone.

  3. Young people are often partly aware of algorithmic influence but feel limited control, and their coping strategies are unevenly distributed.

This answer keeps changing

When new evidence or a better source comes in, this page is updated (it's on version 2, last changed 49 minutes ago). Follow it to be told when that happens.

Generated cinematic image: A smartphone beside a newspaper and reading glasses.Up nextHow do social media algorithms create toxic feeds, and can users switch them off?How do social media recommendation algorithms contribute to 'toxic' feeds, and what options do users have to turn them off or change them?

Ask this Sylo

Still wondering about something?

Answers come only from this page's reviewed material, with citations, and say plainly when the page doesn't cover it yet.

Follow the story

This page changes as sources and experiences are reviewed. Follow it, share it or add what you know.

CommentsFollow

Behind this page

Who's adding to it, where it comes from, how it changed and what would make it better. Always open to everyone.

Discussion

Bring this topic into focus. Add a useful source, a concrete example or a different view.

Sources

Numbers match the citations in the article. A working link isn't proof that a page supports a claim; check the quoted passage and date.

  1. 1
    Trap of Social Media Algorithms: A Systematic Review of Research on Filter Bubbles, Echo Chambers, and Their Impact on Youth
    Societies (Ahmmad et al.)Published Oct 30, 2025Checked Oct 18, 2026
    “A total of 30 studies were analyzed, using the PRISMA 2020 framework, encompassing computational audits, simulation modeling, surveys, ethnographic accounts, and mixed-methods designs across diverse platforms, including Facebook, YouTube, Twitter/X, Instagram, TikTok, and Weibo. Results reveal three consistent patterns: (i) algorithmic systems structurally amplify ideological homogeneity, reinforcing selective exposure and limiting viewpoint diversity; (ii) youth demonstrate partial awareness and adaptive strategies to navigate algorithmic feeds, though their agency is constrained by opaque recommender systems and uneven digital literacy; and (iii) echo chambers not only foster ideological polarization but also serve as spaces for identity reinforcement and cultural belonging. Despite these insights, the evidence base suffers from geographic bias toward Western contexts, limited longitudinal research, methodological fragmentation, and conceptual ambiguity in key definitions. This review highlights the need for integrative, cross-cultural, and youth-centered approaches that bridge empirical evidence with lived experiences.”
  2. 2
    Understanding Echo Chambers in Recommender Systems: A Systematic Review
    International Journal of Advanced Computer Science and Applications (Saissi et al.)Published Jan 1, 2025Checked Oct 18, 2026
    “Echo chambers refer to the phenomenon in which individuals are consistently exposed to content that aligns with their existing viewpoints. Over time, this can narrow a user’s perspective and make it harder to encounter different opinions. In this systematic literature review, we looked at studies published between 2019 and early 2025 and how they have approached this issue, from understanding the cause, and examining existing detection and mitigation strategies. We went through and organized the main findings, noting patterns in the algorithms used, the role of user behavior, and the influence of the data itself. Several works also suggest ways to introduce more variety into recommendations, aiming to break repetitive exposure. Our review confirms that echo chambers and filter bubbles do exist in recommender systems and that they raise concerns for diversity and fairness. Furthermore, we end by pointing to open questions and possible directions for future work, for both researchers and practitioners.”
  3. 3
    Emotion as a cross-layer mechanism in filter bubbles: a social-psychological perspective.
    Frontiers in psychology (He & Fan)Published Dec 16, 2025Checked Oct 18, 2026
    “This review synthesizes recent research from a social-psychological perspective, arguing that filter bubbles are not produced by algorithms alone but emerge through the recursive interaction of motivated cognitive processing, identity-based social network structures, and algorithmic amplification of behavioral and emotional cues. We identify emotion as an underrecognized yet central mechanism that operates across these layers: emotional states such as anger, threat, and defiant self-worth guide information seeking, reinforce group affiliation, and shape algorithmic recommendation patterns, thereby intensifying filtering dynamics and contributing to attitude extremization. By conceptualizing filter bubbles as systems of cognitive coherence, identity protection, and affective regulation, we propose a dynamic multi-level explanatory model and outline implications for interventions, including reflective reasoning strategies, weak-tie exposure, and approaches that address the emotional and identity foundations of information selection.”
  4. 4
    Algorithmic recommendation and adolescent mental health: a grounded theory study of social and commercial determinants.
    BMC public health (Winstone et al.)Published Jun 24, 2026Checked Oct 18, 2026
    “Algorithms organised what content participants encountered, how frequently, and with what emotional intensity, within broader socioecological contexts. Three interlocking processes sustained exposure; algorithmic reinforcement of engagement, emotional feedback loops between mood and recommendations, and a persistent sense of limited control despite high awareness. Although participants developed adaptive strategies and algorithmic literacy, these were unevenly distributed and often insufficient within engagement-driven, profit-oriented systems.ConclusionsDigital mental health may be produced through interactions between individual capacities, social environments, and commercially driven platform design. Protecting population mental health therefore requires multi-level action, including developmentally appropriate social media and algorithmic literacy education alongside structural reforms to recommendation systems, transparency, and platform governance.”
  5. 5
    Intelligent Systems, Vulnerable Minds: A Framework for Radicalization to Violence in the Age of AI.
    Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, IncPublished Mar 23, 2026Checked Oct 18, 2026
    “We conclude by outlining a stage-based framework for governance and future research.Public AbstractAI-driven algorithms designed to maximize engagement on social media, compounded by generative AI, can unintentionally set the stage for radicalization. It begins with Exposure, where algorithms push users toward extreme content because it captures attention. Next, during Reinforcement, algorithms feed users personalized content while AI swarms can create a synthetic consensus that reinforces emerging biases, normalizes extremity, and insulates users from alternative views. Third, during Group Integration, individuals are absorbed into extremist networks, reinforced by human peers, AI companions, and bot swarms that validate radical beliefs and deepen identity ties. By exploiting psychological needs for belonging and certainty, this stage becomes particularly pernicious, potentially opening the door for violence. We propose policy measures that can reduce radicalization at each stage.”
  6. 6
    Toxic algorithms wouldn't let them go - now Australia wants an off switch
    BBC NewsPublished Oct 16, 2026Checked Oct 18, 2026
    “The Australian government hopes to protect social media users from being served content they don't want to see.”

How it changed

Published 1 time since Oct 18, 2026.

  1. Version 2Oct 18, 2026Live now

    AI-prepared Starting Map from live research.

    • First published version.
Every version, side by side

Help improve it

The brief is open about what's uncertain. These are the specific gaps that new material would fill.

Open questions

  • Which user controls — chronological feeds, pausing personalisation, curating follows — actually reduce exposure to harmful content, and by how much?

    No answers yet

  • What form will Australia's proposed "off switch" take, and will it be mandatory for platforms?

    No answers yet

  • How much of polarisation and distress is caused by recommendation algorithms versus users' own choices and social networks?

    No answers yet

  • Do the patterns found mostly in Western studies hold on platforms and in regions that are under-researched?

    No answers yet

Explore how this topic connects

Narrower questions connect to broader Sylos. Explore their findings, sources and the people contributing to each.

Ask this Sylo

Answers only from “How do AI recommendation algorithms create toxic feeds, and can users switch them off?”

Ask anything about this page. The AI reads only its reviewed brief, sources and contributions, cites what it used, and says when the page doesn't cover something.