The 29-Year-Old Behind The Voice of AI | Mati Staniszewski x Nikhil Kamath | WTF Online

Overview

Conversation between Mati Staniszewski (founder/CEO of 11 Labs) and Nikhil Kamath about voice AI, AI-native hardware, product strategies and market opportunities.

Core theme: voice will become a main interface for computing, and achieving that requires solving technical, product and go‑to‑market challenges.

Key technological concepts & product features

Voice quality and interaction

• Human‑level speech generation is required: natural intonation, conveyed emotion, quick responses, the ability to be interrupted and to behave conversationally.
• Both speech understanding (speech‑to‑text) and speech generation (text‑to‑speech) are needed to make voice interactions feel natural.

Knowledge integration & memory

• Voice agents must access relevant user and business knowledge (CRMs, event notes, historical context) and maintain “memory” so responses are personalized and useful.
• Integration layers and connectors (to legacy systems and data stores) are critical for deployment value—more so than just the underlying foundation model.

Form factors and capture

• Potential devices: behind‑the‑ear headphones, glasses, pendants, wristbands, phone companions and, in the long run, neural interfaces.
• Tradeoffs: battery life, ergonomics/acceptability of form factor, and the ability to capture non‑verbal cues.
• Research directions include detecting mouth/muscle movement (subvocal speech) to enable silent or private input.

Real‑time translation

• Wearables (earbuds, glasses) could enable real‑time cross‑language translation.
• Main blockers are hardware latency and form‑factor constraints, not algorithmic capability.

Localization and dubbing

• 11 Labs’ creative/localization tools can recreate voices, preserving intonation and emotion, and dub content into other languages.
• Human‑in‑the‑loop review is still necessary for high‑stakes content (e.g., political leaders, important interviews).
• Challenges include preserving emotion when sentence structure changes across languages; possible future integration with lip reanimation for video.

Agent platform vs creative platform

• 11 Labs has two product lines:
  • Creative platform for creators (narrations, voiceovers, localization).
  • Agents platform for voice agents used in customer support, education, training, etc.
• Voice marketplace: creators can create/authenticate voices and earn revenue; 11 Labs has already paid creators via this marketplace.

Deployment & delivery modes

• Voice agents can be delivered through:
  • Phone numbers (voice calls)
  • Website widgets/concierges
  • Integrated in apps
  • In‑car assistants or embedded device experiences
• Example flows: AI‑SDR augmentation for lead qualification, voice concierge on e‑commerce sites, government citizen support apps.

Practical product examples and customers

• Nothing: early AI‑assisted headphones testing for personalization and voice features.
• MasterClass: recreating teacher voices (e.g., Gordon Ramsay, Chris Voss) for interactive learning.
• Lex Fridman × Narendra Modi podcast: high‑quality dubbing/localization with human review.
• Meesho: automated customer support handling tens of thousands of calls.
• TVS Motor: e‑commerce/after‑sales voice flows that improved customer satisfaction and lead qualification.
• Ukrainian government citizen app: large‑scale voice‑enabled government super‑app.

Pricing and product mechanics

• Automated dubbing: roughly a few dollars per hour of automated dubbing (cost increases with human review).
• High‑quality or sensitive projects require additional human verification and higher pricing.

Market analysis, risks and industry observations

Market opportunity

• Dubbing/localization is a smaller market today, but interactive voice use cases (education, customer service, in‑car, e‑commerce) are much larger and expected to grow significantly over 5 years.
• Strong opportunities in lagging domains: automotive, healthcare, e‑commerce, financial services.

Competition and platform risks

• Large model providers (OpenAI, Google) will likely expand into agent/voice spaces; companies built on top of them face cannibalization risk.
• Defensive strategies: combine domain expertise, deep integrations, monitoring/trust mechanisms and multi‑platform/open‑source hedges instead of relying on a single foundation model provider.

Valuations and investment climate

• Some skepticism about inflated valuations in pockets (e.g., GPU/inference resellers built on Nvidia), but recognition that many AI companies can command high multiples given potential scale.

Geopolitics and data residency

• Expectation of a more multi‑polar world: countries will favor local data residency, localized AI stacks and national platforms, potentially fragmenting global products and creating opportunities for regional players.

Social and ethical considerations

• Voice agents raise questions about loneliness/intimacy and implications for education (personal tutors vs learning how to learn).
• Authenticity and trust will become important buying criteria.
• Platform incentives matter: current algorithmic incentives often reward outrage; new social products should re‑align incentives toward authenticity, verification and constructive discourse.

Actionable guidance for builders and entrepreneurs

• Pick a domain where you have expertise and incumbents lag (automotive, healthcare, traditional services).
• Start with a high‑impact entry point: customer experience or voice automation (call centers, support flows), then expand into in‑product or in‑car experiences.
• Prioritize integrations: connecting voice agents to legacy systems, CRM and telemetry is where long‑term value accrues.
• Build defensibility beyond the voice model: collect data, implement monitoring/evaluation frameworks, ensure compliance/trust, and foster community/voice marketplaces.
• Hedge platform risk: be portable across multiple foundation models and consider open‑source alternatives.
• For creator use cases: combine voice recreation and localization with optional human review to balance scale and quality.

Future features and R&D directions

• Lip reanimation to match dubbing with facial motion.
• Real‑time, low‑latency translation inside wearables.
• Subvocal detection for “silent” speech interaction.
• Improved multi‑language prosody preservation in localization.
• Voice agents as integrated social media companions/assistants that summarize and interact with personalized feeds.

Reviews / guides / tutorials (implicit)

• For creators:
  • Post‑process recordings to fix missing lines and smooth voice output.
  • Localize and dub podcasts into multiple languages via the 11 Labs UI, adding human‑in‑the‑loop edits when required.
• For enterprises:
  • Deploy voice agents for customer support, lead qualification (AI‑SDR), in‑car assistants and education/training.
  • Typical deployment channels: phone numbers, website widgets, embedded assistants in apps or devices.

Main speakers / sources

• Mati Staniszewski — founder/voice of 11 Labs; discusses products, research, deployments and the future of voice.
• Nikhil Kamath — interviewer; investor/entrepreneur who probes product, market and social implications.