What Is an AI Safety Institute — and What Does It Actually Do?
A government body that stress-tests powerful AI models for dangerous capabilities before they ship — the closest thing frontier AI has to an independent inspector.
Read more →AI Safety
AI safety is the research field focused on making sure AI systems behave as intended and don’t cause unintended harm. This hub follows the labs, institutions, and debates working to keep increasingly capable AI under control.
Combine with:
UK Safety Institute Finds Universal Jailbreak in OpenAI's GPT-5.6
OpenAI's newly published GPT-5.6 system card discloses that UK AI Security Institute testers built a universal jailbreak within hours, unlocking the model's cyber-attack capabilities.
Read more →What Is a Responsible Scaling Policy — and Why Do AI Labs Gate Their Own Models?
A responsible scaling policy is a frontier AI lab's own rulebook for when a model gets too capable to release without extra safeguards. Here is how the idea works and who uses it.
Read more →What Is the AI Safety Index — and How Are AI Companies Graded?
The AI Safety Index is an independent report card that grades leading AI companies on how seriously they manage risk. Here's how the grading actually works.
Read more →Future of Life Institute: No AI Firm Scores Above a C+
The Future of Life Institute's latest AI Safety Index gave Anthropic the top grade among nine major AI developers — a C+ — while three companies failed outright.
Read more →Illinois Becomes First US State to Mandate AI Safety Audits
Governor JB Pritzker signed a law requiring the largest AI developers to undergo annual independent safety audits, the first such mandate in the US.
Read more →What Is AI Safety — and Why Does It Matter?
AI safety is the research field focused on making sure AI systems behave as intended and don't cause unintended harm. Here's what that means in practice — and why governments and labs are racing to get it right.
Read more →What Is Claude? Anthropic's AI Assistant, Explained
Claude is an AI assistant developed by Anthropic, built on a safety-first training approach and available through the web, mobile apps, and a developer API.
Read more →What Is Anthropic? The AI Safety Lab Behind Claude
Anthropic is an AI safety company that builds Claude, one of the world's most capable AI assistants. Founded in 2021 by researchers who left OpenAI over safety concerns, it is now valued at nearly $1 trillion.
Read more →Most Deployed AI Agents Have No Published Safety Evaluations
A multi-institution index of 30 deployed AI agents finds that 25 lack published internal safety results and 23 have no third-party testing, raising urgent questions as agentic systems take on increasingly consequential tasks.
Read more →