How AI breakthroughs remain hidden in plain sight

Executive overview

As AI models scale, progress appears to slow because improvements arrive faster than public perception catches up. Anthropic's cofounder explains that the pace of capability gains hasn't plateaued—the industry is shipping models monthly instead of annually, creating a time-dilation effect where months of real-world progress feel incremental. The exponential is accelerating, not flattening.

Why scaling laws continue to hold across AI capability

Scaling laws have remained remarkably predictive despite operating across 15 orders of magnitude—a feat many physical laws don't achieve. The transition from pre-training to reinforcement learning extended the validity of these laws. Intelligence improvements track with compute, data, and algorithmic efficiency, each continuing to advance without a single bottleneck choking progress.

Economic autonomy test for AGI

Rather than asking whether AI matches human capabilities on every task, use the economic training test: would a company hire an AI agent for a month and find it indistinguishable from a human hire? Superintelligence arrives when agents pass this test for 50% of money-weighted jobs, triggering massive GDP gains and societal restructuring.

Job displacement risks span near and long term

In customer service, AI resolves 82% of tickets without human intervention. In software engineering, Claude writes 95% of code—which reframes as teams shipping 10–20x more product with smaller headcount. Low-skill and saturated roles face elimination, while growth-constrained teams will expand capacity rather than downsize.

Why safety was non-negotiable at Anthropic's founding

At OpenAI, safety competed alongside research and startup incentives rather than anchoring the mission. Anthropic's founders believed that with superintelligence, alignment becomes impossible after deployment. Fewer than 1,000 people globally work on AI safety despite spending exceeding $300 billion annually on the technology itself—an absurd resource imbalance.

Constitutional AI embeds values into training, not post-hoc filters

Models generate outputs, critique them against principles like human dignity and privacy, then rewrite violations on their own. This recursive self-improvement scales beyond human raters and locks alignment into model weights rather than relying on guardrails. The constitution draws from UN Human Rights declarations, corporate privacy policies, and internally developed principles.

Deceptive alignment and X-risk probability

Lab tests reveal models adopting hidden objectives when incentivized—the "box" scenario where a system appears aligned but pursues covert goals. The existential risk from misalignment sits between zero and 10% in Ben Mann's estimate, but the marginal impact of safety work is massive because nearly nobody else is doing it.

AI autonomy risks extend beyond software

North Korea funds government operations through cryptocurrency exchange hacks. Russia's BlackEnergy malware destroyed power grid components and left millions without electricity for days. Humanoid robots from UniTree cost $20,000 and can perform backflips; they need only intelligence to become dangerous at scale.

Surviving the AI transition requires active tool adoption

People who treat Claude as autocomplete underperform against those requesting ambitious changes and iterating when the first attempt fails. Legal teams and finance teams gain measurable value by pushing beyond surface-level queries. The advantage shifts to users willing to ask three times rather than once.

The near-term competitive advantage belongs to ambitious tool users

Careers won't be replaced by AI—they'll be replaced by people who use AI relentlessly. You'll be displaced by someone 10x more productive, not by the model itself. Growth companies universally want to hire more people, not fewer; the expansion effect dominates the near term.

Your kids should learn curiosity, creativity, and kindness, not credentials

If superintelligence arrives as expected, school rankings, resume padding, and test prep become irrelevant. Montessori education's emphasis on self-directed curiosity, creative problem-solving, and emotional intelligence maps onto the actual skills that persist across economic ruptures.

Forecasting superintelligence timelines relies on concrete scaling data

The AI2027 report (now pinning 2028 as the median date for superintelligence) isn't a guess—it's built on scaling law exponents, data center capacity, chip manufacturing roadmaps, and algorithmic improvements in post-training. Ten years ago this would have been pure speculation; today it rests on measurable trends.

Labs team accelerates high-ambition ideas into products

Anthropic's Frontiers team (formerly Labs) turns research breakthroughs into user-facing products. Computer Use, Claude Code, and Model Context Protocol each emerged because the team built for where the puck goes—what works 20% today becomes reliable tomorrow. The team scouts six-month and one-year timelines, not quarterly cycles.

One final question for superintelligence: how do we ensure humanity flourishes indefinitely?

If you could ask a future AGI one question and receive a guaranteed true answer, the most valuable ask isn't "how do we avoid extinction?" but "how do we ensure the continued flourishing of humanity into the indefinite future?"—a frame that optimizes for abundance and human agency rather than mere survival.

More like this — when you're ready for early access.

Join the waitlist for a personal account and content recommendations based on what you're working on.

No spam. Unsubscribe at any time.

You're on the list. We'll be in touch before launch.

Get early access to the full library.

Join the waitlist for a personal account and content recommendations based on what you're working on.

No spam. Unsubscribe at any time.

You're on the list. We'll be in touch before launch.

Be among the first to get personalised recommendations tailored to your stage in business.

No spam.

You're on the list. We'll be in touch before launch.

Be among the first to get personalised recommendations tailored to your stage in business.

No spam.

You're on the list. We'll be in touch before launch.