Video summary

iOS 27 Beta - 200+ Changes/Features!

Main summary

Key takeaways

Technology

Tech-focused summary of the iOS 27 beta walkthrough (200+ changes)

Spotlight indexing + Apple Intelligence integration

  • Apple has completely overhauled Spotlight indexing.
  • The changes are tied to revamped Apple Intelligence models and Apple Foundation models.
  • Expected outcomes:
    • More accurate/efficient basic Spotlight searches
    • Faster and more reliable personal context for Apple Intelligence
  • Siri and Spotlight are merged into a single interaction surface.

Unified Siri / Spotlight UI + new gesture model

  • New “liquid glass” Siri animation that reacts to the content behind it while scrolling.
  • Siri can be invoked normally (“Hey Siri”) or via swipe down to open the Spotlight/Siri interface.
  • New top-swipe behaviors: swiping down from an open app triggers the Siri/Spotlight interface.
  • Notification Center / Control Center / Siri are reorganized into separate sections, with Siri taking a central section.

New dedicated Siri app (conversation history + context continuity)

  • Siri now includes a dedicated app that stores conversation history.
  • Highlighted features:
    • Search past conversations
    • Resume or follow up without re-explaining context
    • Rename conversations
    • Attach photos/files to provide context
    • Share conversations as PDF
    • Playback audio from Siri conversations
  • Cross-device context sync: conversations and context sync between iPhone and Mac (macOS 27).

“World knowledge” with sources

  • Siri answers can include tap-to-view sources (e.g., Wikipedia and other online sources).
  • Emphasis on improved handling of back-to-back follow-ups using world knowledge and context.

ChatGPT extension support (hidden entry + voice options)

  • Siri supports switching to third-party extensions.
  • ChatGPT extension can be selected via a hidden long-press → “Ask” → extensions flow.
  • ChatGPT is described in this demo as less full-featured than Siri.
  • Siri settings include voice selection for the ChatGPT extension, including default vs custom voices.
  • Voice customization appears limited to newer hardware (mentioned: iPhone 17 Pro / iPhone “Air”; not iPhone 16 Pro).

Visual Intelligence / camera + Siri-in-camera

  • The Camera app adds “Siri mode”: ask Siri about what you’re seeing (e.g., bottle/water example).
  • “Siri / image search” in detail views is mentioned; external image search availability may be unstable in early beta.

Image Playground upgrades + wallpaper generation + inpainting/extend

  • Image Playground is redesigned with suggested images.
  • Adds more photorealistic generation (noted as “promising” but imperfect).
  • Tools include:
    • Cleanup/edit by marking areas to remove
    • Generate photorealistic images
    • Wallpaper creation directly
    • Pinch-to-zoom + “extend” to expand wallpaper borders using AI
  • Wallpaper creation can be prompt-driven with optional style + reference images.
    • Some guardrails/content filtering are mentioned (e.g., a “Ferrari” prompt causing an error).

Home Screen / UI performance polish

  • New extra-large widgets that occupy an entire home screen page.
  • Improved home screen icon rearranging (less jitter).
  • New dynamic iOS 27 wallpaper:
    • Changes with time of day
    • Includes tint/color customization
  • Additional improvements claimed:
    • Smoother unlocking
    • Faster lock screen switching
    • Reduced “sparkle” around icons; sharper icon rendering
  • “Liquid glass” is extended across the UI, including Find My and Maps.

Lock Screen changes + security/accessibility

  • Lock screen clock can be moved smaller near the date.
  • Password/security:
    • More password help options, including:
      • Forget passcode flow
      • Security lockout recovery
  • Lock screen behavior:
    • Lock screen stays awake while browsing notifications
  • Music widget:
    • Swipe-away bug noted (no easy way to bring it back).

Find My + privacy improvements

  • Find My gains liquid glass support and updated iconography (items → AirTag style).
  • Location privacy:
    • Hide location from specific individuals
    • Hide has an expiration
    • Can be manually restored
  • Location sharing becomes more flexible, with hour/day/custom minute-level scheduling.

Network + connectivity enhancements

  • Wi‑Fi settings show Wi‑Fi type (e.g., Wi‑Fi 6 / 802.11ax).
  • Intelligent connectivity:
    • iPhone can use cellular alongside Wi‑Fi for reliability
    • UI notification when it switches/adds cellular
  • Personal Hotspot becomes more efficient (less battery/heat).
  • AirDrop improvements observed (faster recognition/reliability).
  • NFC described as faster/more reliable.
  • Control Center:
    • “Connectivity” control can be resized and includes a small focus toggle.

System performance and battery/low power mode

  • Faster app launches and improved Photos loading speed.
  • Low Power Mode improvements:
    • Faster camera launch
    • Lower power drain for camera usage
    • Better usability vs iOS 26 (still lower smoothness than normal)

iOS 27 “recovery” redesign (Mac-like)

  • New recovery mode entry mimics Mac behavior (hold side button to enter recovery options).
  • Recovery assistant UI includes:
    • Try to fix software issues
    • Software updates (with Apple data sharing mention)
    • Diagnostics mode
    • Erase all content and settings
    • Recovery mode via computer restore
  • UI details like language selection, Wi‑Fi, and battery display are called out.

Messaging (iMessage) and communication UX upgrades

  • Messages:
    • Auto-resend when a message fails
    • Suggested actions from message notifications (add to Calendar/Notes)
    • Drawing support inside messages
    • Customize/remove record audio button in text field to reduce accidental voice notes
    • Audio message playback speed button
    • Per-message sending progress bars (parallel sending)
    • Indicates when a draft exists
    • Search by phone number/contact/nickname
  • Mail:
    • New ranking system for search relevance
    • Mail indexing improvements when iPhone is locked
  • FaceTime:
    • Mention of dual capture (front + rear camera simultaneously), targeted to newer iPhone hardware.

Siri-based agents for password fixing (Apple Intelligence “agentic” flow)

  • Security → auto fix passwords using Apple Intelligence:
    • Automatically visits sites, signs in, and changes passwords
    • Handles verification codes (“automatic verification”)
    • Not always perfect in beta; described as finicky, though at least one successful case is claimed
  • Goal: reduce user work on weak/compromised passwords while improving security.

Photos / camera / editing upgrades

  • “Visual intelligence” is better integrated (doesn’t hijack photo capture).
  • Enhanced editing tools:
    • Cleanup with quality options (removes objects while preserving background more)
    • Extend (smartly fills image borders)
    • Reframe (adjust perspective/angle)
  • Other Photos features:
    • Ask Siri / image search in detail view
    • Star ratings per photo
    • Sync immediately option for iCloud Photos (pause in Low Power/Low Data)
    • New collections (e.g., identity documents, captured-by-me)
    • Keywords for image search via tagging/indexing
    • Save video frame as photo
    • Improved lens switching during zoom video
    • Selection view for already selected items across albums/libraries
    • Shared albums enhancements (filtering, temporary expiry, broader emoji reactions, full-resolution sharing)
  • Notes: new slideshow customization options and better frame extraction.

Shortcuts + Safari + productivity

  • Shortcuts editor redesign:
    • New storage model / global values
    • Multiple automation triggers per shortcut
    • Expanded “what’s on screen” value extraction
    • New triggers: screenshot saved, notification received
    • Text-to-shortcut using Apple Intelligence (plain-language input)
  • Safari:
    • Tab topics organization (auto topic generation)
    • Safari extension creation from text prompt
    • “Notify me” for webpage change monitoring (site update notifications)
  • Freeform:
    • Dark mode support
    • Collaborative folders with permissions
  • Weather/Calendar/Reminders:
    • Expanded UI views (hourly/10-day, highlights, precipitation/wind)
    • Natural language event creation (slightly finicky in beta)
    • Extra-large widgets for Calendar/Reminders
    • Reminders grocery list curation with more language support for categorization

Main speaker / source

  • Jeff Benjamin (host), 9to5Mac YouTube channel.

Original video