Nick Bostrom: AI can and should be paused but only once we're on the verge of super intelligence.
Predictor: Nick Bostrom · ep#232 "Ben Horowitz: xAI Executive Exodus, Apple's AI Crisis, The Pace of AI | EP #232" · source
Prediction text
Nick Bostrom: AI can and should be paused but only once we're on the verge of super intelligence. | Nick Bostonramm, who also in the past 24 or 48 hours put out a a wonderful essay that I'd recommend everyone read called Optimal Timing for Super Intelligence, argues that AI can and should be paused, but only once we're on the verge of super intelligence.
Verbatim quote
Nick Bostonramm, who also in the past 24 or 48 hours put out a a wonderful essay that I'd recommend everyone read called Optimal Timing for Super Intelligence, argues that AI can and should be paused, but only once we're on the verge of super intelligence.
Resolution evidence
Bostrom 'should pause at superintelligence threshold' — normative.
Predictor: Nick Bostrom
Evidence about this node from Nick Bostrom is multiplied by κ in /api/intake. Lower κ = less weight; floors at 0.10 (effectively silenced) and caps at 1.00 (full weight).
Reference class
This node isn't linked to a reference class. The Bayesian update applies without outside-view blending.
Probability over time
Milestone chain
- 2026-02-01hitNick Bostrom publishes 'Optimal Timing for Superintelligence' working paper arguing for swift-to-AGI then strategic pauseHow: Bostrom's named essay 'Optimal Timing for Superintelligence' published with thesis that pause is appropriate but only on the verge of superintelligenceSource: deep_research_enrichedconf 98%
- 2026-09-01 → 2028-06-30pendingMajor-country (US, EU, China, UK) issues formal AI pause framework conditional on capability thresholdHow: Statute, executive order, or treaty by G7+China/Russia conditioning AI development pause on specific capability/risk indicatorsSource: deep_research_enrichedconf 40%
- 2027-01-01 → 2028-06-30pendingFrontier lab (OpenAI/Anthropic/DeepMind) publicly invokes pause clause in compute scaling commitment letterHow: Public statement or filing by frontier lab explicitly pausing or delaying training run citing capability/safety thresholdSource: deep_research_enrichedconf 35%
- 2027-06-01 → 2028-06-30pendingIndustry consensus capability evaluation (METR, AISI, Apollo) flags 'verge of superintelligence' threshold metHow: Multiple respected eval orgs publicly assess a model crossed pre-defined ASI-proximity benchmarksSource: deep_research_enrichedconf 35%
- 2027-06-01 → 2028-06-30pendingInternational AI safety treaty negotiations include Bostromian 'optimal timing' framing in formal diplomatic textHow: UN/G7/Bletchley successor summit communique or treaty text references conditional pause / optimal timing logicSource: deep_research_enrichedconf 25%
What if this resolves?
Click a button to clamp this prediction and run a Gibbs sample. Returns the predictions whose marginals shift most. ~30s per run; ideal for stress-testing "if X resolves, what else moves?"
Evidence chain
Network propagation neighbors
Top incoming (parents)
Edges that influence THIS node's belief
| Kind | Node | Their prob | P(c|s=T) | P(c|s=F) | Δ implied |
|---|---|---|---|---|---|
| prereq | SEM_038 Digital superintelligence (smarter than any human at anythin — Elon Musk | 19.3% | 0.500 | 0.050 | -0.178 |
| killer | TK01 AGI Capability Plateau (2026-27 Training Stall) | 15.0% | 0.050 | 0.500 | +0.115 |
| prereq | 241_025 Elon Musk predicts launch per hour cadence to populate satel — Elon Musk | 37.8% | 0.500 | 0.050 | -0.090 |
| prereq | 237_023 Baby AGI agents will need and develop an 'immune system' for — Alex Wissner-Gross | 40.7% | 0.500 | 0.050 | -0.089 |
| prereq | 241_057 Elon Musk believes robot building robot is imminent — Elon Musk | 44.8% | 0.500 | 0.050 | -0.072 |
Top outgoing (children)
Predictions THIS node influences
| Kind | Node | Their prob | P(c|s=T) | P(c|s=F) | Δ implied |
|---|---|---|---|---|---|
| prereq | CMQ_003 By 2030, AI models will surpass peak human expert levels acr — Sam Altman | 22.8% | 0.350 | 0.050 | -0.085 |
Ticker exposure
Beneficiaries (13)
Prerequisites (10)
| Type | Pred | Title | Domain | Lag |
|---|---|---|---|---|
| prereq | 238_010 | AI takeoff/inflection is happening now | AI | — |
| prereq | 239_003 | We are currently in AI hard takeoff | AI | — |
| prereq | 241_057 | Elon Musk believes robot building robot is imminent | Robotics | — |
| prereq | 241_025 | Elon Musk predicts launch per hour cadence to populate satellite constellations | Space | — |
| prereq | 237_023 | Baby AGI agents will need and develop an 'immune system' for prompt injection and cybersecurity threats in real time. | AI | — |
| prereq | SEM_038 | Digital superintelligence (smarter than any human at anything) will arrive as early as 2025 or 2026. | AI/AGI | — |
| correlate | S_NO_AI_PAUSE_5Y | No major AI pause through 2031 | ai_regulatory_pause | — |
| correlate | S_AI_PAUSE_2027 | AI pause beginning 2027 | ai_regulatory_pause | — |
| correlate | S_AI_PAUSE_2026 | Major-country AI pause beginning 2026 | ai_regulatory_pause | — |
| killer | TK01 | AGI Capability Plateau (2026-27 Training Stall) | — | — |
Dependents (1)
| Type | Pred | Title | Domain | Lag |
|---|---|---|---|---|
| prereq | CMQ_003 | By 2030, AI models will surpass peak human expert levels across virtually all cognitive domains — onset of true superintelligence. | AI | — |
Linked documents (1)
| Sim | Source | Title | Market prob | Polarity | Reviewed | Published |
|---|---|---|---|---|---|---|
| 0.560 | manifold | Will I avoid distractions during seminars, study groups, and workshops until the end of the month? | 21% | mentions | pending | 2026-05-08 |
Raw metadata
{
"nia": false,
"url": "https://www.youtube.com/watch?v=C1GLT9_tag0",
"mode": "CITED_PREDICTION",
"role": "Cited-Analyst",
"caveats": "Normative recommendation (should) and prognostication (can)",
"context": "I I think Nick Bostonramm, who also in the past 24 or 48 hours put out a a wonderful essay that I'd recommend everyone read called Optimal Timing for Super Intelligence, argues that AI can and should be paused, but only once we're on the verge of super intelligence.",
"to_year": 2031,
"cited_by": "Alex Wissner-Gross",
"verbatim": "Nick Bostonramm, who also in the past 24 or 48 hours put out a a wonderful essay that I'd recommend everyone read called Optimal Timing for Super Intelligence, argues that AI can and should be paused, but only once we're on the verge of super intelligence.",
"direction": "HAPPEN",
"from_year": 2026,
"timeframe": "when near super intelligence",
"conv_level": "MEDIUM",
"milestones": [
{
"kind": "llm_pre_event",
"label": "Nick Bostrom publishes 'Optimal Timing for Superintelligence' working paper arguing for swift-to-AGI then strategic pause",
"source": "deep_research_enriched",
"status": "hit",
"weight": 0.4,
"ordinal": -12,
"source_id": null,
"confidence": 0.98,
"source_url": "https://nickbostrom.com/optimal.pdf",
"expected_date": "2026-02-01",
"observed_date": "2026-02-01",
"research_origin": "deep_research",
"measurement_criterion": "Bostrom's named essay 'Optimal Timing for Superintelligence' published with thesis that pause is appropriate but only on the verge of superintelligence"
},
{
"kind": "prereq",
"label": "AI takeoff/inflection is happening now",
"status": "hit",
"weight": 0.5,
"ordinal": -11,
"source_id": "238_010",
"expected_date": "2026-04-29",
"observed_date": "2026-04-29"
},
{
"kind": "prereq",
"label": "Digital superintelligence (smarter than any human at anything) will arrive as early as 2025 or 2026.",
"status": "pending",
"weight": 0.5,
"ordinal": -10,
"source_id": "SEM_038",
"expected_date": "2026-06-15",
"observed_date": null
},
{
"kind": "prereq",
"label": "Elon Musk predicts launch per hour cadence to populate satellite constellations",
"status": "pending",
"weight": 0.5,
"ordinal": -9,
"source_id": "241_025",
"expected_date": "2026-06-21",
"observed_date": null
},
{
"kind": "prereq",
"label": "We are currently in AI hard takeoff",
"status": "pending",
"weight": 0.5,
"ordinal": -8,
"source_id": "239_003",
"expected_date": "2026-08-30",
"observed_date": null
},
{
"kind": "scenario_signal",
"label": "Scenario fires: Major-country AI pause beginning 2026",
"status": "pending",
"weight": 0.3,
"ordinal": -7,
"source_id": "S_AI_PAUSE_2026",
"expected_date": "2026-12-31",
"observed_date": null
},
{
"kind": "prereq",
"label": "Baby AGI agents will need and develop an 'immune system' for prompt injection and cybersecurity threats in real time.",
"status": "pending",
"weight": 0.5,
"ordinal": -6,
"source_id": "237_023",
"expected_date": "2027-06-18",
"observed_date": null
},
{
"kind": "prereq",
"label": "Elon Musk believes robot building robot is imminent",
"status": "pending",
"weight": 0.5,
"ordinal": -5,
"source_id": "241_057",
"expected_date": "2027-06-24",
"observed_date": null
},
{
"kind": "llm_pre_event",
"label": "Major-country (US, EU, China, UK) issues formal AI pause framework conditional on capability threshold",
"source": "deep_research_enriched",
"status": "pending",
"weight": 0.4,
"ordinal": -4,
"source_id": null,
"conf
... (truncated)