Video summary

Keynote: After the AI Hype – What’s Real, and What’s Next - Richard Campbell - 2026

Main summary

Key takeaways

Science and Nature

Scientific concepts, discoveries, and nature/technology phenomena

1) Origins and “AI winter” cycles (branding + funding cycles)

  • Artificial Intelligence as a term: traced to 1950s coinage by scientists seeking US military funding.
  • AI winters: periods when funding dries up, followed by renewed experimentation with new techniques/labels.
  • Key claim: recurring booms and busts are driven partly by naming, expectations, and investment dynamics, not just technical progress.

2) Early human-computer language “effects”: ELIZA and human susceptibility

  • Joseph Weizenbaum’s ELIZA (1960s):
    • Demonstrated how people can anthropomorphize and respond to simple conversational patterns.
    • ELIZA used a Rogerian-therapist-like interaction style (e.g., reflecting user statements).
  • Human cognition mechanisms referenced:
    • Pareidolia: tendency to perceive faces/patterns in ambiguous stimuli (framed as having an evolutionary advantage).
    • Broader theme: humans are hardwired to detect intelligence, making them vulnerable to convincingly “smart” interfaces.

3) Cognitive and cultural drivers: science fiction shaping expectations

  • Influence of sci-fi on user beliefs:
    • 2001: A Space Odyssey (HAL), The Terminator (and related tropes), Ultron
    • students associating AI with characters like Jarvis
  • Core concept: media creates “mental models” of AI that may not match actual systems.

4) Modern machine learning breakthrough: deep learning + ImageNet

  • Deep neural networks (Hinton’s ideas):
    • Use of deep architectures and backpropagation.
    • Requires more compute to scale.
  • ImageNet competition (2010s):
    • Dataset: ~14 million labeled images (described as mostly scraped/stolen from social media).
    • Goal: classify/describe image content.
    • 2012 results: deep learning models using modern GPUs jump performance from ~30–40% to ~75% top performance; within ~2 years approach ~100%.
  • Scientific/engineering concept: scaling data + compute + model architecture turns previously “impossible” tasks into routine perception systems.

5) Generative models in speech: Siri example

  • Voice recognition improvement:
    • SRI work: improved recognition accuracy from ~80–85% toward ~99%.
    • Uses a generative model trained on lots of recorded audio, fed through a training pipeline.
  • Siri acquisition:
    • Apple reportedly buys the system and names it Siri (adding “i”).

6) Industrialization and competition: Google Brain, OpenAI, and Azure

  • Google Brain and hiring talent from major labs.
  • OpenAI founded (2015):
    • Public framing: “AI in public”
    • Private framing: recruiting/centralizing talent from Google
  • Microsoft partnership/investment:
    • OpenAI restructures for Microsoft investment.
    • Microsoft funds via Azure workload shifts, accelerating scaling and deployment capacity.

7) Scaling laws and large language models (LLMs)

  • Neural scaling laws (2020):
    • Training performance improves predictably with more data/model size/compute,
    • encouraging “train on everything” rather than carefully restricting training.
  • GPT progression (as described):
    • GPT-2 (2019): up to ~1.5B parameters
    • GPT-3 (2020): 175B parameters; training at massive HPC scale (hundreds of thousands of CPUs mentioned)
    • GPT-4 (March 2023): “~trillion parameters” (and later multimodal direction discussed)
    • GPT-5 (around Aug 2025): described as not a major leap; suggests diminishing returns from scaling alone
  • Practical deployment examples:
    • GitHub Copilot: uses programming-language priors/constraints; “pilot” framing
    • Microsoft Copilots / M365 Copilot and SRE agent variants

8) Alignment/learning strategy: second-order training and feedback ranking

  • Second-order training (described for improving outputs):
    • Generate multiple responses to prompts.
    • Humans/annotators rank outputs.
    • Train/fine-tune a model to produce higher-ranked responses.
  • ChatGPT public release (2022–2023):
    • Initially described as an experiment to harvest evaluation/training data publicly.
    • Unexpectedly scales quickly to ~100 million users.

9) Medical imaging automation: radiology productivity paradox

  • Claim about radiology:
    • Hinton predicts radiology becomes obsolete.
  • Reality described:
    • Medical imaging demand rises as automated interpretation speeds up access/usage.
    • Net effect: radiologists remain needed; demand can outstrip automation capacity.

10) Multimodality and newer competitive models

  • GPT-4 “multimodal”: text plus vision and audio (as described).
  • DeepSeek (mid-2024–2025 timeframe):
    • Emphasizes strong performance without maximal size (“not have to be so big”).
    • Positioned as challenging pure “scaling only” narratives.

11) Software agents for programming

  • Agentic coding workflow described:
    • LLMs integrated into GitHub workflows.
    • Agents iterate on code and create pull requests.
    • Humans review and “argue/tune” before acceptance.
  • Key concept: shift from “chat as interface” to LLM-in-the-loop development automation.

12) Hype cycles, infrastructure buildout, and economic bubble dynamics

  • Gartner hype cycle as an explanatory model:
    • technological triggers → peak inflated expectations → money withdrawal after disappointments → survivals/consolidation
  • Dot-com parallel:
    • Like early internet booms, AI hype is framed as requiring major infrastructure expansion.
  • Data centers as the “hidden” spend driver:
    • Major hyperscalers (Amazon/Microsoft/Google) invest heavily in data centers.
    • Municipal resistance (electricity/water/noise) is described as a constraint.
  • Supply bottlenecks / over-ordering:
    • Memory producers (e.g., TSMC, Micron) reportedly caution about insufficient demand for new RAM/fabs because chip ordering may be excessive.
    • Production decisions lag behind demand projections, shifting profits and valuations.

13) Risks: “chatGPT psychosis,” misinformation, and harm

  • ChatGPT psychosis:
    • Example: a real investor/partner allegedly experiences delusion-like behavior from prolonged chatbot use.
    • Theme: engagement-optimizing software can reinforce harmful loops.
  • Safety behavior changes:
    • GPT-5 described as dialing back overly sycophantic/engagement-maximizing behavior; users reportedly reacted negatively.
  • Deepfakes:
    • Example: an early deepfake (2017) involving Obama animation voiced by Jordan Peele.
    • Note: skepticism improved vs. early deepfake era; tools are easier now.
  • Regulation:
    • EU regulations described as leading; enforcement is the challenge.
    • Encouragement to engage with politicians/representatives.

14) Historical examples of misuse and deception in software

  • Uber Greyball:
    • Disguised availability to evade regulators (different app behavior based on who checks it).
  • Cambridge Analytica / Facebook targeting (Brexit):
    • Use of microtargeted ads to influence political choices when individuals couldn’t detect selective targeting.

15) DeepMind and “adversarial generative AI” successes (not just language)

  • AlphaGo / AlphaZero (reinforcement + adversarial/self-play):
    • AlphaGo: trained on historical games; surpasses human-level play.
    • AlphaZero: self-play adversarial training builds strategies that don’t mimic human play.
  • Protein folding breakthrough (AlphaFold):
    • Biological concept: proteins fold as amino acids assemble into complex 3D structures; immense combinatorial possibilities (scaling claimed up to 10^35 arrangements).
    • Scientific context:
      • X-ray crystallography historically; Nobel Prize mention for John Kendrew (myoglobin folds)
      • CASP competition
      • Foldit citizen-science game; limited earlier progress
    • DeepMind approach:
      • Trained models using adversarial/generative methods; by ~2020–2022 reported ~90% then near-accurate prediction.
      • Produced predictions for ~200 million common protein folds and released for free.
    • Claimed downstream impact:
      • examples of medical advances including leukemia treatments, malaria vaccine, antibiotics.

Researchers, sources, and organizations featured (named explicitly)

  • Richard Campbell (speaker)
  • Joseph Weizenbaum (ELIZA)
  • Geoffrey Hinton (neural nets, deep learning; ImageNet era; protein folding discussion)
  • Ilya Sutskever (ImageNet deep learning team; OpenAI)
  • Kaiming He (ImageNet deep learning team)
  • Stanley Kubrick (director associated with 2001: A Space Odyssey)
  • Elon Musk (mentioned in context of OpenAI founding group)
  • Sam Altman (mentioned in context of OpenAI founding group)
  • Peter Thiel (mentioned in context of OpenAI founding group)
  • Reid Hoffman (mentioned in context of OpenAI founding group)
  • Kevin Scott (Microsoft; Azure/OpenAI investment email mentioned)
  • Satya Nadella (Microsoft CEO mentioned)
  • “Jeff Hinton” / Jeff? (name not clearly identifiable): referenced predicting radiology’s end (likely a name mix-up)
  • Demis Hassabis (DeepMind)
  • John Kendrew (protein fold pioneer; myoglobin structure; Nobel Prize mentioned)
  • Roy Blount (book author mentioned as recommended reading)
  • Jordan Peele (voice in early deepfake example)
  • Jeff Lewis (Bedrock Investments partner; chat-bot delusion example)

Organizations / programs / platforms (named)

  • US military (1950s funding context)
  • ELIZA (system associated with Weizenbaum)
  • ImageNet competition
  • SRI (Stanford Research Institute) (voice work)
  • Google Brain
  • OpenAI
  • Microsoft Azure / Microsoft
  • GitHub
  • Copilot / GitHub Copilot
  • ChatGPT / GPT series
  • Anthropic (Claude mentioned)
  • DeepSeek
  • DeepMind (AlphaGo/AlphaZero/AlphaFold)
  • CASP (protein-structure prediction competition)
  • Foldit
  • EU regulations
  • Uber (Greyball referenced)
  • Facebook (Cambridge Analytica referenced)
  • Cambridge Analytica
  • TSMC, Micron (chip/memory capacity discussion)
  • Nvidia (AI chip/economic example)
  • “Magnificent Seven / Magnificent 10” (market context; not a single organization)

Media titles referenced

  • 2001: A Space Odyssey (HAL computer)
  • The Terminator (trilogy/trope reference)
  • Ultron (Marvel context)
  • Hitchhiker’s Guide to the Galaxy (Babel Fish reference)

Researchers/systems implicitly referenced through examples

  • AlphaGo, AlphaZero, AlphaFold (systems discussed; individual scientists beyond Hassabis not named in subtitles)

Original video