The dawn of the age of holograms | Alex Kipman

Summary of Technological Concepts, Product Features, and Analysis (from the Subtitles)

Vision: Moving Beyond “2D Computing” to Human-Centered 3D Holograms

• The speaker argues that today’s screen-based computing limits human interaction to a 2D, monitor/pixel world.
• The goal is a new reality where technology connects people directly.
• Systems should sense what we see, touch, and feel, instead of forcing people to adapt to devices.

Microsoft HoloLens as a Key Step

• HoloLens is described as the first fully untethered holographic computer.
• Core benefit: bringing 3D holographic content into the physical world, improving perception and interaction beyond normal ranges.
• Applications mentioned include:
  • Volvo: designing cars differently with HoloLens
  • Case Western University: changing how medical students learn
  • NASA: letting scientists explore planets holographically (not only via screens)

How “Machines” Interact with the World: Input, Output, and Haptics

The speaker frames interaction as a matrix of three capabilities:

1. Input / sensing humans
   • Examples: speech recognition and biometric authentication
2. Output into the environment
   • Examples: holograms that place digital information into the real world
3. Haptics / energy exchange
   • Enabling virtual objects to be felt (e.g., temperature/force feedback, “push back”)

Claim: as machines better understand reality, they can provide more personal, granular control over switching between real and virtual.

Digital vs. Analog Reality (Conceptual Framing)

• Digital computing is portrayed as causal and discrete (binary, true/false).
• The physical world is portrayed as analog with uncertainty (described via “shades of gray,” including quantum-style framing).
• The speaker compares screen-based computing to “superpowers” that displace space and time, such as:
  • television effects
  • calling someone after a TED talk

“Holographic Teleportation” Demo and Mars Use Case

• A TED-stage demo connects the speaker with Dr. Jeffrey Norris (NASA JPL), described as being in multiple places “including Mars.”
• The Mars visualization is described as a precise holographic replica of Mars built from data captured by the Curiosity Mars Rover.
• Scientific/mission rationale:
  • Scientists can explore Mars “as humans should,” rather than through decades of screens and keyboards.
• The speaker also discusses “dialing” between real and virtual to enable “magical” perspectives, such as:
  • visualizing invisible wavelengths
  • climbing/visualizing environments
  • potential future touch-based mineral sensing

Direct Q&A: Field of View vs. Clarity, Spatial Mapping, and Deployment Realism

Field of View Concern

• The press question challenges whether the field of view is sufficient.
• The speaker responds that field of view isn’t the right metric.
• The key metric is radiance / angular resolution:
  • how many points of light are delivered (i.e., the hologram’s “crispness”).
• Because the TED demo camera uses a fish-eye lens, it can capture a wider view than the human eye—but the hologram’s angular resolution is what matters.

Is the Home Experience the Same, Including Environment Mapping?

• HoloLens uses spatial mapping (real-time mapping) at about five frames per second.
• For the TED stage, the team pre-maps the environment to avoid wireless/network issues that could cause holograms to disappear.
• Reasoning:
  • holograms are generated by the HoloLens on the speaker
  • stage monitors display what that HoloLens outputs
  • unreliable connectivity could cause the system to fail during a live event

Scientific Usefulness Without Touch/Smell

• A question notes that holograms provide sight but not touch or smell.
• NASA’s representative replies that the technologies are scientifically useful now, used to:
  • improve Mars exploration
  • support astronauts on the space station
  • design the next generation of spacecraft

---

Main Speakers / Sources

• Alex Kipman (Microsoft; speaker and demo presenter)
• Dr. Jeffrey Norris (NASA Jet Propulsion Laboratory; source for the Mars holographic/mission explanation)
• Helen Walters (interviewer/question asker during the Q&A segment)