SyloSpace

Is AI dangerous?

Research documents concrete near-term AI risks, while longer-term existential risks remain debated and unmeasured.

Updated 54 minutes ago5 min readVersion 2
CommentsFollow

Covers: The main documented and debated risks of AI, including misuse, accidents, bias, economic disruption, and existential concerns, drawing on research, expert surveys, and official reports. It does not provide technical instructions for building AI systems or cover fictional portrayals.

Also answers: What are the risks of artificial intelligence? · Is artificial intelligence a threat? · Can AI harm humanity?

A robotic arm in a clean, minimalist laboratory setting
Photo: Brecht Corbeel

Before you read, make a guess

Fill in the blank: ?% of healthcare AI studies were benchmark or simulated-workflow studies

Drag the slider to fill in the blank

0%50%100%

The short answer

Interpretation AI-prepared starting map

The evidence does not support a single verdict on whether AI is dangerous. Documented, near-term risks are well described in the research literature: AI safety reviews identify concerns including explainability, interpretability, robustness, reliability, fairness, bias, and adversarial attacks, and note the need for systems that align with human values and operate within ethical frameworks. In healthcare specifically, a scoping review found safety-relevant risks including hallucinated content, omission of clinically critical information, demographic bias, privacy vulnerabilities, limited explainability, and automation bias. Longer-term and existential risks are actively debated rather than settled: a systematic review of AGI risk research identified risks such as AGI removing itself from human control, unsafe goals, poor ethics, inadequate management, and existential risks, but also found the literature base limited, with few peer-reviewed articles and no standardised terminology. AGI does not yet exist; projections of human-level intelligence within roughly two decades and rapid superintelligence beyond that are expectations, not observations.1234

What this rests on7 independent sources
  • Evidence 15
  • Interpretation 2

Did this answer your question?

Be the first to vote

In brief

  1. Near-term, documented risks are concrete and studied: bias, privacy exposure, hallucination, omission of critical information, limited explainability, adversarial attacks, and automation bias.125

    Evidence-backed
  2. Existential and AGI risks are argued and debated, not measured: AGI does not yet exist, and the AGI risk literature is limited, with few peer-reviewed articles and no standardised terminology.34

    Evidence-backed
  3. Perceived catastrophe or extinction risk from AGI is reported as higher than for other existential risks and rising faster, with experts and non-experts agreeing it is pressing even though the basis for that agreement is unclear.4

    Evidence-backed
  4. The safety research field is young and unevenly distributed: computer science dominates, safety engineering is rarely involved, and cross-disciplinary collaboration is limited.6

    Evidence-backed

At a glance

The picture in numbers

Live · updated just now

Scoping review of large language models in healthcare

89%

89 in every 100

of healthcare AI studies were benchmark or simulated-workflow studies
Scoping review of large language models in healthcare

11%

11 in every 100

of healthcare AI studies were prospective workflow-embedded evaluations

The evidence behind it

7 sources
  • Reviews of many studies4
  • Other studies and data3

When it was published

Newest from 2026

20212026
Sources on this page by kind and year
SourceKindYear
The risks associated with Artificial General Intelligence: A systematic reviewReviews of many studies2021
How Does Artificial Intelligence Pose an Existential Risk?Other studies and data2021
Artificial General Intelligence, Existential Risk, and Human Risk PerceptionOther studies and data2023
A Systematic Literature Review on AI Safety: Identifying Trends, Challenges, and Future DirectionsReviews of many studies2024
Systematic Review on AI Safety and Future Research AgendaReviews of many studies2025
Large language models in healthcare: applications, evaluation frameworks, and governance pathways - a scoping review and multidimensional framework.Reviews of many studies2026
Privacy and Artificial IntelligenceOther studies and data2021

The community around it

No one has added to this page yet. Firsthand experience, a newer study or a different reading of the numbers would show up here, credited to you.

What it means for you

Which fits you?

Pick the situation closest to yours. Each answer says what it rests on.

If you are deploying AI in a clinical or other high-stakes setting

the evidence supports cautious deployment in selected tasks under structured oversight, with prospective evaluation, standardised reporting, equity-focused audits, and lifecycle governance with continuous monitoring.2

Evidence-backed

If you are assessing privacy risk in an AI system

consider each constituent technology of the system separately and its interactions, so privacy-enhancing tools can be targeted at specific components rather than applied generically.5

Evidence-backed

If you want to judge claims about AI safety

separate documented near-term risks (bias, hallucination, privacy, robustness, adversarial attacks) from argued long-term risks (control problem, AI race dynamics, weaponization, existential risk), since the two rest on different kinds of evidence.17

Interpretation

If you are weighing how seriously to take AGI existential-risk warnings

note that AGI does not yet exist, that projections of human-level intelligence within roughly two decades are expectations rather than observations, and that the AGI risk literature is limited and lacks standardised terminology.43

Evidence-backed

If you are designing or governing AI systems

the literature calls for safety-focused design across data management, model development, and deployment, alignment with human values, and operation within ethical frameworks.1

Evidence-backed

The full story · 3 chapters

01

Documented and near-term risks

AI summary:Safety research lists concrete technical concerns, and healthcare and privacy studies detail specific near-term risks and oversight needs.

Evidence-backed

Evidence-backed: AI safety research groups the main technical concerns as explainability, interpretability, robustness, reliability, fairness, bias, and adversarial attacks, and argues that AI systems should be designed with safety in mind across data management, model development, and deployment, aligning with human values and operating within ethical frameworks. A complete safety framework is described as needed so systems do not inadvertently cause harm.1

Evidence-backed

Evidence-backed: In healthcare, a scoping review reports that safety-relevant risks of large language models include hallucinated content, omission of clinically critical information, demographic bias, privacy vulnerabilities, limited explainability, and automation bias. Reported benefits concentrated on documentation efficiency, text quality, and knowledge synthesis. The review concludes that current evidence supports cautious deployment in selected tasks under structured oversight, and that progress depends on prospective evaluation, standardised reporting, equity-focused audits, and lifecycle governance with continuous monitoring.2

Evidence-backed

Evidence-backed: On privacy, one paper argues that the privacy risks of AI are best understood by considering each constituent technology of an AI system separately and its interactions, so that privacy-enhancing tools can be applied in a targeted way to reduce risk in specific components. It proposes a generalised North American approach to assessing privacy risk that can be adapted to different sociopolitical contexts.5

02

AGI and existential risk: what is claimed and what is known

AI summary:AGI risk research names many hazards but is limited, and existential warnings rest on projections and debate rather than observation.

Evidence-backed

Evidence-backed: A systematic review of AGI risk research identified risks including AGI removing itself from the control of human owners or managers, being given or developing unsafe goals, development of unsafe AGI, AGI with poor ethics, morals and values, inadequate management of AGI, and existential risks. The same review found the literature base limited: few peer-reviewed articles and modelling techniques focused on AGI risk, little domain-specific risk research, no specific definitions of AGI functionality, and no standardised terminology.3

Evidence-backed

Evidence-backed: One chapter critically examines three commonly cited reasons for thinking AI poses an existential threat: the control problem, the possibility of global disruption from an AI race dynamic, and the weaponization of AI. It notes that Turing warned AI could one day pose an existential risk and that recent advances have brought a renewed set of existential warnings.7

Evidence-backed

Evidence-backed: An analysis drawing on forecaster and opinion data reports that AGI does not yet exist but is projected to reach human-level intelligence within roughly the next two decades, after which many experts expect it to far surpass human intelligence rapidly. It argues the prospect of superintelligent AGI poses an existential risk because there is no reliable method for ensuring AGI goals stay aligned with human goals. The same analysis reports that perceived risk of a world catastrophe or extinction from AGI is greater than for other existential risks, and that the increase in perceived risk over the last year is steeper for AGI than for nuclear war or human-caused climate change. It states that experts and non-experts agree AGI is a pressing existential risk, but that the basis for this agreement remains obscure.4

03

How the research field is organised

AI summary:A bibliometric review finds AI safety research led by the USA and China, with computer science dominating and limited cross-disciplinary work.

Evidence-backed

Evidence-backed: A bibliometric review of 123 peer-reviewed articles from 2014 to 2025 mapped the evolution of AI safety research. It found the USA and China lead in publication numbers, with the USA's influence described as unique globally, while cross-disciplinary collaboration remained limited: computer science almost dominates contributions and safety engineering is rarely involved. The authors propose a five-point multilevel research agenda to guide emerging challenges and adaptive regulation.6

Readers' pollNo answers yet

How concerned are you about the potential risks of artificial intelligence?

How concerned are you about the potential risks of artificial intelligence?

Your individual answer is private. Only totals are shown.

Your turn

Have your say

Quick votes, open to everyone. See where you stand the moment you vote. Only totals are ever shown.

How do you feel about this?

No votes yet

Quick questions from connected pages

Before you go

What to remember

The few things worth keeping from this page.

  1. Near-term, documented risks are concrete and studied: bias, privacy exposure, hallucination, omission of critical information, limited explainability, adversarial attacks, and automation bias.

  2. Existential and AGI risks are argued and debated, not measured: AGI does not yet exist, and the AGI risk literature is limited, with few peer-reviewed articles and no standardised terminology.

  3. Perceived catastrophe or extinction risk from AGI is reported as higher than for other existential risks and rising faster, with experts and non-experts agreeing it is pressing even though the basis for that agreement is unclear.

This answer keeps changing

When new evidence or a better source comes in, this page is updated (it's on version 2, last changed 54 minutes ago). Follow it to be told when that happens.

A laboratory bench is full of scientific equipmentUp nextHow are AI models tested for dangerous capabilities like bioweapon instructions?How do researchers test AI models for dangerous capabilities, such as providing instructions for creating bioweapons?

Ask this Sylo

Still wondering about something?

Answers come only from this page's reviewed material, with citations, and say plainly when the page doesn't cover it yet.

Behind this page

Who's adding to it, where it comes from, how it changed and what would make it better. Always open to everyone.

Discussion

Nobody has added anything yet. If you have experience, evidence or a different view, you could be the first.

Sources

Numbers match the citations in the article. A working link isn't proof that a page supports a claim; check the quoted passage and date.

  1. 1
    A Systematic Literature Review on AI Safety: Identifying Trends, Challenges, and Future Directions
    IEEE Access (Salhab et al.)Published Jan 1, 2024Checked Oct 10, 2026
    “Artificial intelligence (AI) is revolutionizing many aspects of our lives, except it raises fundamental safety and ethical issues. In this survey paper, we review the current state of research on safe and trustworthy AI. This work provides a structured and systematic overview of AI safety. In which, we emphasize the significance of designing AI systems with safety focus, encompassing elements from data management, model development, and deployment. We underscore the need for AI systems to align with human values and operate within mounted ethical frameworks. In addition, we notice the need for a complete safety framework that courses the development and implementation of AI systems, ensuring they do not inadvertently cause damage to humans. Our results show that AI safety is associated with model learning techniques, verification and validation methods, failure modes, and managing AI autonomy. As discussed in the literature, the main concerns include explainability, interpretability, robustness, reliability, fairness, bias, and adversarial attacks.”
  2. 2
    Large language models in healthcare: applications, evaluation frameworks, and governance pathways - a scoping review and multidimensional framework.
    Frontiers in digital health (Ferreira & Rosa)Published Sep 18, 2026Checked Oct 10, 2026
    “The evidence base was dominated by benchmark and simulated-workflow studies (89%), with limited prospective workflow-embedded evaluations (11%). Reported benefits concentrated on documentation efficiency, text quality, and knowledge synthesis; safety-relevant risks included hallucinated content, omission of clinically critical information, demographic bias, privacy vulnerabilities, limited explainability, and automation bias. Studies were geographically concentrated in North America and East Asia, with limited representation from Sub-Saharan Africa, South Asia, and Latin America.ConclusionsCurrent evidence supports cautious deployment of LLMs in selected healthcare tasks under structured oversight. Translational progress depends on prospective evaluation, standardised reporting, equity-focused audits, and lifecycle governance with continuous monitoring. The proposed five-dimensional framework (technical performance, clinical validity, equity, workflow integration, governance) coupled with a three-tier risk model is intended to support researchers and healthcare organisations in assessing readiness and implementing LLM-enabled tools responsibly.”
  3. 3
    The risks associated with Artificial General Intelligence: A systematic review
    Journal of Experimental & Theoretical Artificial Intelligence (McLean et al.)Published Aug 13, 2021Checked Oct 10, 2026
    “The review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Sixteen articles were deemed eligible for inclusion. Article types included in the review were classified as philosophical discussions, applications of modelling techniques, and assessment of current frameworks and processes in relation to AGI. The review identified a range of risks associated with AGI, including AGI removing itself from the control of human owners/managers, being given or developing unsafe goals, development of unsafe AGI, AGIs with poor ethics, morals and values; inadequate management of AGI, and existential risks. Several limitations of the AGI literature base were also identified, including a limited number of peer reviewed articles and modelling techniques focused on AGI risk, a lack of specific risk research in which domains that AGI may be implemented, a lack of specific definitions of the AGI functionality, and a lack of standardised AGI terminology. Recommendations to address the identified issues with AGI risk research are required to guide AGI design, implementation, and management.”
  4. 4
    Artificial General Intelligence, Existential Risk, and Human Risk Perception
    arXiv (Cornell University) (Mandel)Published Nov 15, 2023Checked Oct 10, 2026
    “Artificial general intelligence (AGI) does not yet exist, but given the pace of technological development in artificial intelligence, it is projected to reach human-level intelligence within roughly the next two decades. After that, many experts expect it to far surpass human intelligence and to do so rapidly. The prospect of superintelligent AGI poses an existential risk to humans because there is no reliable method for ensuring that AGI goals stay aligned with human goals. Drawing on publicly available forecaster and opinion data, the author examines how experts and non-experts perceive risk from AGI. The findings indicate that the perceived risk of a world catastrophe or extinction from AGI is greater than for other existential risks. The increase in perceived risk over the last year is also steeper for AGI than for other existential threats (e.g., nuclear war or human-caused climate change). That AGI is a pressing existential risk is something on which experts and non-experts agree, but the basis for such agreement currently remains obscure.”
  5. 5
    Privacy and Artificial Intelligence
    IEEE Transactions on Artificial Intelligence (Curzon et al.)Published Apr 1, 2021Checked Oct 10, 2026
    “For the purpose of this research, a North American perspective of privacy is adopted. Impact statement-While an appreciation of the privacy risks associated with artificial intelligence is important, a thorough understanding of the assortment of different technologies that comprise artificial intelligence better prepares those implementing such systems in assessing privacy impacts. This can be achieved through the independent consideration of each constituent of an artificially intelligent system and its interactions. Under individual consideration, privacy-enhancing tools can be applied in a targeted manner to reduce the risk associated with specific components of an artificially intelligent system. A generalized North American approach to assess privacy risks in such systems is proposed that will retain applicability as the field of research evolves and can be adapted to account for various sociopolitical influences. With such an approach, privacy risks in artificial intelligent systems can be well understood, measured, and reduced.”
  6. 6
    Systematic Review on AI Safety and Future Research Agenda
    International Conference on System Reliability and Safety Engineering (SRSE) (Zhang & Lu)Published Nov 20, 2025Checked Oct 10, 2026
    “The Artificial Intelligence (AI) safety is critical for ensuring dependable deployment and mitigating risks in modern products and systems. This study conducts a systematic literature review using bibliometric analysis to map the evolution, key themes, and research gaps in AI safety. The bibliometrix R package was employed to analyze 123 peerreviewed articles (2014-2025) from Web of Science. The analysis included keywords co-occurrence, thematic evolution mapping, and collaboration network assessment. The USA and China lead in the publication number, but the influence of the USA is unique globally. Meanwhile, cross-disciplinary collaboration remained limited, especially computer science field almost dominate the contribution while safety engineering discipline rarely involved. Finally, a five-point multilevel research agenda was proposed to guide future emerging challenges and adaptive regulation.”
  7. 7
    How Does Artificial Intelligence Pose an Existential Risk?
    Oxford University Press eBooks (Vold & Harris)Published Nov 10, 2021Checked Oct 10, 2026
    “Alan Turing, one of the fathers of computing, warned that artificial intelligence (AI) could one day pose an existential risk to humanity. Today, recent advancements in the field of AI have been accompanied by a renewed set of existential warnings. But what exactly constitutes an existential risk? And how exactly does AI pose such a threat? In this chapter, we aim to answer these questions. In particular, we will critically explore three commonly cited reasons for thinking that AI poses an existential threat to humanity: the control problem, the possibility of global disruption from an AI race dynamic, and the weaponization of AI.”

How it changed

Published 1 time since Oct 10, 2026.

  1. Version 2Oct 10, 2026Live now

    AI-prepared Starting Map from live research.

    • First published version.
Every version, side by side

Help improve it

The brief is open about what's uncertain. These are the specific gaps that new material would fill.

  • “How the research field is organised” rests on one independent source

    A second, independent source that confirms or challenges it would make this part more reliable.

Open questions

  • How reliable are projections that AGI will reach human-level intelligence within roughly two decades, given that AGI does not yet exist and the AGI literature lacks standardised definitions and terminology?

    No answers yet

  • Why do experts and non-experts agree that AGI is a pressing existential risk, when the basis for that agreement is described as obscure?

    No answers yet

  • What would prospective, workflow-embedded evaluations show, given that most healthcare LLM evidence comes from benchmarks and simulated workflows rather than real deployments?

    No answers yet

  • What changes if safety engineering and other disciplines become more involved in AI safety research, which is currently dominated by computer science?

    No answers yet

Around this topic

Sylos connect: narrower topics report up to broader ones, so what's learned in one place shows up where it matters.

Ask this Sylo

Answers only from “Is AI dangerous?”

Ask anything about this page. The AI reads only its reviewed brief, sources and contributions, cites what it used, and says when the page doesn't cover something.