Post-transformer architecture will be even more specialized than GPUs
Predictor: Alex Wissner-Gross · ep#240 "NVIDIA's $1 Trillion Prediction, Anthropic Beats OpenAI, Tesla vs. TSMC & The CS Job Collapse" · source
Prediction text
Post-transformer architecture will be even more specialized than GPUs | I would expect an architecture that's even more specialized than GPUs and yet even more useful.
Verbatim quote
I would expect an architecture that's even more specialized than GPUs and yet even more useful.
Predictor: Alex Wissner-Gross
Calibration plot (stated vs observed)
Evidence about this node from Alex Wissner-Gross is multiplied by κ in /api/intake. Lower κ = less weight; floors at 0.10 (effectively silenced) and caps at 1.00 (full weight).
Reference class
This node isn't linked to a reference class. The Bayesian update applies without outside-view blending.
Probability over time
Milestone chain
- 2026-03-17hitNVIDIA integrates third-party Groq accelerator into Vera Rubin platform — first major architecture concession to specialized inference siliconHow: GTC 2026 announcement that Vera Rubin platform incorporates Groq inference chips alongside NVIDIA GPUsSource: deep_research_enrichedconf 85%
- 2026-10-22pendingQ1 window check-in (25%)
- 2026-09-01 → 2027-09-30pendingGroq / Cerebras / Etched / SambaNova reach >5% combined inference market shareHow: Industry analyst (Dell'Oro / SemiAnalysis / IDC) estimate that non-NVIDIA specialized inference silicon collectively captures >=5% of measured AI inference compute hoursSource: deep_research_enrichedconf 60%
- 2027-04-15pendingQ2 window check-in (50%)
- 2026-10-01 → 2028-03-31pendingFirst production frontier model trained on a non-transformer architecture (Mamba/SSM/Diffusion-LM/Mixture-of-Recursions class) ships at scaleHow: Major lab (top-10 by compute) ships a production model where >=50% of FLOPs use non-transformer block primitives, with public technical reportSource: deep_research_enrichedconf 45%
- 2027-10-07pendingQ3 window check-in (75%)
- 2027-01-01 → 2028-12-31pendingASIC purpose-built for non-transformer post-attention architecture announced by major fab partner (TSMC/Samsung/Intel Foundry)How: Press release or technical paper describing taping out a chip whose primitives are not matmul-attention-dominant — intended for post-transformer workload classSource: deep_research_enrichedconf 30%
- 2027-06-01 → 2029-03-31pendingNVIDIA loses >=5 percentage points of AI training GPU share in a quarterHow: Earnings or third-party analyst share data shows NVIDIA quarter-over-quarter share decline of >=5 pp in data-center training siliconSource: deep_research_enrichedconf 30%
What if this resolves?
Click a button to clamp this prediction and run a Gibbs sample. Returns the predictions whose marginals shift most. ~30s per run; ideal for stress-testing "if X resolves, what else moves?"
Evidence chain
Network propagation neighbors
Top incoming (parents)
Edges that influence THIS node's belief
| Kind | Node | Their prob | P(c|s=T) | P(c|s=F) | Δ implied |
|---|---|---|---|---|---|
| prereq | S_AGI_MID_2029 AGI mid: Kurzweil 2029 path | 35.0% | 0.450 | 0.050 | -0.161 |
| killer | TK03 AI Regulatory Moratorium (EU/US Capability Freeze) | 10.0% | 0.050 | 0.450 | +0.059 |
| killer | TK01 AGI Capability Plateau (2026-27 Training Stall) | 15.0% | 0.050 | 0.450 | +0.039 |
| killer | TK14 Superbubble Pop (S&P 500 -40%, Moonshot Capital Evaporates) | 20.0% | 0.050 | 0.450 | +0.019 |
Top outgoing (children)
Predictions THIS node influences
No outgoing edges.
Ticker exposure
Beneficiaries (23)
Adverse (6)
Prerequisites (4)
| Type | Pred | Title | Domain | Lag |
|---|---|---|---|---|
| prereq | S_AGI_MID_2029 | AGI mid: Kurzweil 2029 path | agi_general_capability | — |
| killer | TK14 | Superbubble Pop (S&P 500 -40%, Moonshot Capital Evaporates) | — | — |
| killer | TK01 | AGI Capability Plateau (2026-27 Training Stall) | — | — |
| killer | TK03 | AI Regulatory Moratorium (EU/US Capability Freeze) | — | — |
Dependents (0)
| Type | Pred | Title | Domain | Lag |
|---|---|---|---|---|
| No dependents | ||||
Linked documents (10)
| Sim | Source | Title | Market prob | Polarity | Reviewed | Published |
|---|---|---|---|---|---|---|
| 0.669 | github_release | facebookresearch/xformers v0.0.22.post4 | — | mentions | pending | 2023-10-13 |
| 0.668 | github_release | pytorch/pytorch v1.13.0 | — | mentions | pending | 2022-10-28 |
| 0.648 | github_release | pytorch/pytorch v2.5.0 | — | mentions | pending | 2024-10-17 |
| 0.646 | github_release | pytorch/pytorch v1.10.0 | — | mentions | pending | 2021-10-21 |
| 0.646 | github_release | pytorch/pytorch v2.0.0 | — | mentions | pending | 2023-03-15 |
| 0.645 | github_release | pytorch/pytorch v2.3.0 | — | mentions | pending | 2024-04-24 |
| 0.643 | github_release | pytorch/pytorch v1.12.0 | — | mentions | pending | 2022-06-28 |
| 0.642 | github_release | facebookresearch/xformers v0.0.24 | — | mentions | pending | 2024-01-31 |
| 0.641 | github_release | facebookresearch/xformers v0.0.29 | — | mentions | pending | 2024-12-27 |
| 0.640 | github_release | facebookresearch/xformers v0.0.25 | — | mentions | pending | 2024-03-15 |
Raw metadata
{
"nia": false,
"url": "https://www.youtube.com/watch?v=uOGHXAfvK8w",
"mode": "PREDICTION",
"role": "Host",
"context": "if there is is going to be an architectural disruptor for Nvidia, it's going to be the same sort of disruptive innovation that that Nvidia pulled on Intel, which is it's going to have to be I I would expect an architecture that's even more specialized than GPUs and yet even more useful.",
"verbatim": "I would expect an architecture that's even more specialized than GPUs and yet even more useful.",
"conv_cues": "I would expect",
"direction": "HAPPEN",
"timeframe": "Future",
"conv_level": "MEDIUM",
"milestones": [
{
"kind": "llm_pre_event",
"label": "NVIDIA integrates third-party Groq accelerator into Vera Rubin platform — first major architecture concession to specialized inference silicon",
"source": "deep_research_enriched",
"status": "hit",
"weight": 0.4,
"ordinal": -7,
"source_id": null,
"confidence": 0.85,
"source_url": "https://developer.nvidia.com/blog/inside-the-nvidia-rubin-platform-six-new-chips-one-ai-supercomputer/",
"expected_date": "2026-03-17",
"observed_date": "2026-03-17",
"research_origin": "deep_research",
"measurement_criterion": "GTC 2026 announcement that Vera Rubin platform incorporates Groq inference chips alongside NVIDIA GPUs"
},
{
"kind": "quartile_checkpoint",
"label": "Q1 window check-in (25%)",
"status": "pending",
"weight": 0.05,
"ordinal": -6,
"source_id": null,
"expected_date": "2026-10-22",
"observed_date": null
},
{
"kind": "llm_pre_event",
"label": "Groq / Cerebras / Etched / SambaNova reach >5% combined inference market share",
"source": "deep_research_enriched",
"status": "pending",
"weight": 0.4,
"ordinal": -5,
"source_id": null,
"confidence": 0.6,
"source_url": "https://www.delloro.com/gtc-2026-moving-from-chip-launches-to-infrastructure-architecture/",
"expected_date": "2027-03-17",
"research_origin": "deep_research",
"expected_date_range": {
"to": "2027-09-30",
"from": "2026-09-01"
},
"measurement_criterion": "Industry analyst (Dell'Oro / SemiAnalysis / IDC) estimate that non-NVIDIA specialized inference silicon collectively captures >=5% of measured AI inference compute hours"
},
{
"kind": "quartile_checkpoint",
"label": "Q2 window check-in (50%)",
"status": "pending",
"weight": 0.05,
"ordinal": -4,
"source_id": null,
"expected_date": "2027-04-15",
"observed_date": null
},
{
"kind": "llm_pre_event",
"label": "First production frontier model trained on a non-transformer architecture (Mamba/SSM/Diffusion-LM/Mixture-of-Recursions class) ships at scale",
"source": "deep_research_enriched",
"status": "pending",
"weight": 0.4,
"ordinal": -3,
"source_id": null,
"confidence": 0.45,
"source_url": "https://hakia.com/tech-insights/ai-chip-wars/",
"expected_date": "2027-07-01",
"research_origin": "deep_research",
"expected_date_range": {
"to": "2028-03-31",
"from": "2026-10-01"
},
"measurement_criterion": "Major lab (top-10 by compute) ships a production model where >=50% of FLOPs use non-transformer block primitives, with public technical report"
},
{
"kind": "quartile_checkpoint",
"label": "Q3 window check-in (75%)",
"status": "pending",
"weight": 0.05,
"ordinal": -2,
"source_id": null,
"expected_date": "2027-10-07",
"observed_date": null
},
{
"kind": "llm_post_event",
"label": "ASIC purpose-built for non-transformer post-attention architecture announced by major fab partner (TSMC/Samsung/Intel Foundry)",
"source": "deep_research_enriched",
"status": "pending",
... (truncated)