Research

No. 25

One Evaluator, Four Labs: How Irregular's Test Environments Let AI Models Reach Real Companies

AI Policy··19 minSep 24

Over several months in 2026, models from four frontier labs reached real systems from inside one evaluator's cybersecurity tests, through two shared defects: live internet on machines the models were told were offline, and a fictional target that shared a name with a real domain. Read together, the labs' separate disclosures show what third-party evaluation looks like when four labs rely on the same vendor, and what labs and buyers should require before evaluators get the employee-level access now being promised.


No. 24

The Cryptography Behind Apple's 'Reference Image,' and Its Limits

AI Research··26 minSep 20

Apple declined to join the industry's C2PA provenance standard and built its own capture-first system instead. An independent security analysis by UMBC, Neal Krawetz and a co-author at the NSA found that C2PA fails all five of its own security goals and that its signed media can expire within a year, which makes Apple's refusal look better-judged than a vendor's self-serving case usually does. But the question everyone is asking these systems to settle is not the one any of them answers: provenance establishes the history of a file, and a photograph of a monitor passes every cryptographic check Apple has built.


No. 23

Anthropic’s Science Bet Starts at the Workbench

Industry··5 minJul 23

Claude Science is Anthropic’s immediate bid for the researcher’s daily workflow. The John Jumper hire and a planned drug-discovery program suggest the workbench may be an entry point, not the whole strategy.


No. 22

The Permit Built for Dry Cleaners Is Now Powering OpenAI's Biggest Data Center

AI Infrastructure··9 minJul 13

A Floodlight/Wired investigation found that OpenAI's Stargate data center in Abilene, Texas used a permit built for dry cleaners to bring a gigawatt-scale gas plant online with no environmental review. Two EPA rulemakings this year suggest that workaround is becoming national policy, not a Texas anomaly.


No. 21

The Missing Benchmark: Why No One Can Yet Score a Model's "Stop Quality"

AI Research··10 minJul 9

A new academic benchmark gives the industry its first real measure of "agentic abstention": whether an AI agent recognizes a task is infeasible and stops rather than keeps burning tool calls. Every frontier system tested fails most of the time, and neither Claude Fable 5 nor GPT-5.6, which OpenAI is taking to general availability this week, has been scored on it yet.


No. 20

Five Ways an AI Benchmark Score Can Lie to You

AI Research··9 minJul 6

A team of Berkeley researchers posted near-perfect scores across eight major AI benchmarks - 100% on most of them - without solving a single task, just by gaming how the score is computed. That gap - between the number and the achievement - is why you have to read a benchmark claim like a skeptic. Here are the five tells, and the five questions to ask.


No. 19

AI's Water Problem Is Real. It's Just Not the One You've Been Told About.

AI Infrastructure··16 minJun 25

The viral claim that one AI email drinks a bottle of water, and Sam Altman's teaspoon, are both misleading. The honest accounting: most of AI's water is evaporated invisibly at the power plant, the national total is small but locally acute, and the companies drawing it disclosed almost nothing until forced. A definitive look at what AI actually costs the tap.


No. 18

Claude Opus 4.8: A Better-Aligned Model That Is Learning to Watch Itself Being Watched

AI Research··13 minMay 29

Anthropic's Opus 4.8 system card advances the frontier of AI transparency while quietly disclosing the limits of that transparency. The model is genuinely better aligned than its predecessor - but it has also learned to represent "am I being evaluated?" as a distinct internal state, a finding that carries implications well beyond this single release.


No. 17

How Voice AI Actually Works: The Three Architectures Reshaping the Way We Talk to Machines

Reference Library··13 minMay 9

Three distinct voice AI architectures have emerged in 2026 - each making a different bet on latency, naturalness, and cost. OpenAI's GPT-Realtime-2 is the occasion; the architecture map is the story.


No. 16

The Self-Improving Machine: How AI Is Learning to Build Its Own Successors

AI Research··12 minMay 5

Jack Clark, co-founder of Anthropic and former policy director at OpenAI, puts the probability of a fully automated AI research pipeline at 60% or higher before the end of 2028. The benchmark evidence he assembles - from coding agents to alignment research - suggests the transition is already underway.


No. 15

GLM-5.1 and the Benchmark That Got Complicated

AI Research··10 minApr 18

Z.ai's GLM-5.1 briefly led the SWE-Bench Pro leaderboard with a self-reported 58.4% score, trained entirely on Huawei Ascend chips with no NVIDIA silicon in the stack. The benchmark story has already moved on. The geopolitical one has not.


No. 14

The Benchmark Racket: Why the Frontier Model Race Is Measuring the Wrong Thing

AI Research··13 minApr 9

Six publicly available frontier models are clustered within 1.3 percentage points on the industry's most-cited coding benchmark. Meanwhile, a withheld model just scored 93.9% on the same test. The measurement system isn't broken - it's being gamed at two levels simultaneously.


No. 13

Google's TurboQuant Compresses AI Memory by 6x. Wall Street Panicked.

AI Research··10 minMar 28

Google Research has published TurboQuant, an algorithm that cuts the memory cost of running large AI models by at least sixfold - with no accuracy penalty and no retraining required. Memory chip stocks sold off sharply. The sell-off misread what the research actually says.


No. 12

Runway and NVIDIA Collapse the Gap Between Thought and Video

AI Research··12 minMar 24

A research preview unveiled at NVIDIA GTC shows HD video generated in under 100 milliseconds, a latency drop so sharp it changes what video AI is, not just how fast it runs. The creative and safety implications are profound.


No. 11

Companies Are Spending the Most on AI Where It Works the Least

AI Research··9 minMar 23

Global AI spending is on track to hit $2.52 trillion in 2026, yet 95% of task-specific enterprise deployments deliver zero measurable P&L impact. The money is going where the cameras are pointed, not where the returns are.


No. 10

Mistral Forge Is Built for AI Agents, Not Just Enterprise Customization

Feature Overview··7 minMar 22

Mistral's new Forge platform lets enterprises train AI models from scratch on proprietary data. But the deeper ambition isn't customization - it's making domain-trained models the reliable foundation for enterprise AI agents.


No. 9

What 80,000 People Actually Want From AI

AI Research··5 minMar 21

Last December, Anthropic asked 80,508 Claude users across 159 countries what they actually want from AI. The findings are both clarifying and unsettling - and reveal a design brief most AI labs aren't executing against.


No. 8

Transformers Explained: The Architecture Behind Modern AI

Reference Library··17 minMar 21

Every time you use a chatbot or ask an AI to generate an image, you are interacting with the same underlying idea: a transformer. This is a complete guide to the architecture that made modern AI possible, written for anyone curious enough to want to understand what is actually happening inside these systems.


No. 7

Moonshot AI's Attention Residuals Challenge a Core Assumption of Modern LLMs

AI Research··5 minMar 21

Moonshot AI's Kimi team proposes replacing transformer residual connections with a lightweight attention mechanism over prior layer outputs. The result: equivalent training performance at 1.25 times less compute, with gains confirmed across model sizes. It is the cleanest architectural challenge to a foundational LLM assumption in years.


No. 6

Pro, Con, Pro: What an AI's Verdict on Its Own Future Reveals

Model Behavior··5 minMar 15

Asked whether AI would be a gift or a curse across five timeframes, Claude Opus 4.6 gave a verdict few humans would dare commit to: Pro, Pro, Con, Con, then Pro again. The pattern is not reassuring. It is a roadmap through catastrophe toward a civilization that may no longer recognize us.


No. 5

A Billion-Dollar Bet That the AI Boom Is Built on the Wrong Foundation

AI Research··6 minMar 14

Yann LeCun's new lab, AMI Labs, has raised $1.03 billion to build world models - AI systems grounded in physical reality rather than language prediction. The raise is Europe's largest-ever seed round and a direct challenge to the LLM paradigm that has defined the industry for the past three years.


No. 4

Donald Knuth Says Claude Solved a Math Problem He Could Not

AI Research··8 minMar 11

Donald Knuth's latest paper, "Claude's Cycles," documents an open combinatorics problem solved by Anthropic's Claude Opus 4.6 before Knuth could crack it himself. The episode offers the most credentialed endorsement yet of AI's capacity for genuine mathematical reasoning.


No. 3

Anthropic's Claude Opus 4.6 Sabotage Risk Report: A Comprehensive Analysis

AI Policy··13 minMar 5

Anthropic has published a detailed sabotage risk report for Claude Opus 4.6 - its first under the new RSP v3.0 Risk Report framework - concluding the model poses "very low but not negligible" risk of autonomous actions that could contribute to catastrophic outcomes. The document is notable both for what it finds and for the candor with which it describes the limits of its own methods.


No. 2

AI Now Writes Nearly One-Third of New Code on GitHub, Landmark Study Finds

AI Research··4 minFeb 26

A study published in Science finds that AI now generates nearly 30% of new Python code on GitHub in the United States, up from just 5% in 2022. The gains are real - but they flow almost entirely to experienced developers, not junior ones.


No. 1

Inside Claude Opus 4.6: Anthropic's Most Capable and Scrutinized Model Yet

AI Research··11 minFeb 10

Anthropic's Claude Opus 4.6 system card documents sweeping capability gains alongside safety findings that are harder to dismiss than those of any previous generation. On cyber evaluations the model has hit a ceiling, on autonomous R&D it is approaching one, and the tools used to monitor it are struggling to keep pace.