Video summary

How I Turned Claude Into My Personal Assistant (Full Guide)

Main summary

Key takeaways

Technology

Summary of the Video (Technological Concepts + Product/Guide Features)

The speaker describes building a custom “personal operating system” over roughly two weeks. It uses AI to automatically manage and prioritize life tasks, finances, and routines—addressing issues he experienced with manual logging in tools like Notion.


Core Idea: AI-Backed Dashboard with Transportable “Cloud Memory”

  • A custom memory system is built and stored in a database that “remembers everything about him.”
  • The backend stores data; the frontend (dashboard UI) updates based on that stored memory.
  • The approach emphasizes moving away from generic SaaS subscription tools toward purpose-built tools tailored to personal needs.
  • Key claim: the system’s memory can be transported into different LLM apps (e.g., Claude or others), so AI advice and strategy can use personal context from the user’s own database rather than relying on opaque “black box” chat memory.

Major Features (What the System Does)

1) Voice-Note Task Capture From Anywhere (Telegram → Whisper → AI → Dashboard)

  • Uses Telegram as an input channel via a Telegram bot.
  • Users can send voice notes from anywhere.
  • Pipeline:
    • Telegram voice note → transcribed by Whisper
    • Text sent to the AI to categorize and prioritize
    • Logged into a memory database (via Supabase)
    • Dashboard updates automatically with new priorities

Problem solved vs Notion: the speaker didn’t reliably open Notion/notes to manually log tasks, causing missed opportunities.


2) Automated Finance Tracking via Live API

  • Finance view pulls live data into a Google Sheet via API.
  • Dashboard shows:
    • Net worth over time
    • Monthly/day performance
    • Current net worth
  • Mentions a future, deeper finance walkthrough video.

3) End-to-End Routines: Habits, Journaling, CRM, Goals

Calendar

  • Connected to Google Calendar and refreshes live.

Habit Tracking

  • Habits include sub-habits/todos managed via dropdown/check interactions.
  • Completing sub-items completes the main habit and displays completion percentage.

Journaling / Evening Wind-Down

  • Journaling can be done via voice inside the dashboard (or via Telegram microphone input).
  • Text is saved; dashboard shows:
    • Daily summaries
    • Optionally raw transcripts
  • Claim: voice journaling “trains the AI” by building rich personal logs for better future pattern recognition (e.g., sleep → productivity; loneliness → suggested actions).

CRM

  • Described as a difficult component due to glitches (refresh/data not logging).
  • Required multiple debugging iterations.

Goals

  • Weekly/monthly goals (typically 3–5) are shown prominently for daily reminders.

Task Management (CRM / Task Views)

  • Supports starring/flagging key tasks (about 3–5 per day).
  • Drag-and-drop prioritization with Kanban-style views (Notion-like).
  • Completing items moves them into an archive.

4) Nutrition + “Cal AI”-Style Meal Logging

  • Meals are logged with estimated calories using the latest Claude model.
  • Nutrition can connect to a smart estimation algorithm and may optionally accept meal photos sent via Telegram.
  • Tracks protein and calories, connected to the health tab.
  • Mentions future expansion to wearables like Oura Ring / Whoop (not implemented yet).

Build Process (The “Full Guide” / Implementation Tutorial Approach)

  1. Mock UI in Claude Design

    • Creates detailed dashboard layout mocks.
  2. Export Mocks Into “Claude Code” for Functional Build

    • Mentions architecture PDF / downloadable materials (via AI Edge newsletter/Instagram community).
  3. Choose Memory Backend: Supabase

    • Used as the system’s storage/memory persistence layer.
    • Notes alternatives (e.g., Firebase) but chooses Supabase for “sovereign configuration.”
  4. Get AI Access: Anthropic API Key (Claude)

    • Began before Claude 5.5; mentions it could be built with other models too (e.g., ChatGPT/Codex).
  5. Write a Custom Schema

    • Defines a custom data model for categories such as content/products/business ops/finance, etc.
  6. Telegram Bot Integration

    • Bot created via BotFather.
    • Webhook points to a Versal function running through Claude code.
  7. Transcription + Classification Pipeline

    • Voice notes → Whisper transcription
    • Claude reads text → categorizes and logs into Supabase
  8. Security / Login Protection + Integrations

    • Adds password protection and integrates with Google Calendar.
  9. Iterative Debugging

    • Multiple bugs/glitches noted (especially in CRM and nutrition logging).
    • Improvements accumulate through continuous fixes and usage.

Data Safety / Persistence

  • Includes backup/archiving in Supabase so that if Claude deletes data, stored data remains recoverable and can be re-exported.

Practical Workflow Example (How It’s Used Daily)

  • Optional multi-monitor setup:
    • Dashboard always visible on one side
    • Work in the middle
    • Claude/GPT chats on another
  • Capture methods:
    • Type new tasks quickly, or
    • Use a Whisper command on the computer, or
    • Use the Telegram action button + voice prompt on mobile
  • Mentions a mobile version optimized for on-the-go use, connected to the same memory system.

Review / Tutorial Emphasis (What’s Being Taught)

The video functions as a tutorial/guide for:

  • Building an AI personal dashboard OS
  • Implementing a full pipeline:
    • voice capture → transcription → AI classification → database logging
  • Designing a transportable memory system (Supabase-backed)
  • Integrating multiple life systems:
    • tasks/CRM, finances, calendar, habits, journaling, nutrition, goals
  • Demonstrating a real dashboard walkthrough, including:
    • Finance pulse (hidden by default)
    • Key tasks
    • Habits with sub-task completion
    • Journaling with summary/raw transcripts
    • CRM/archiving/Kanban-like prioritization
    • “Brain” section summarizing domains (legal/personal finance/content/products/opsec/business opportunities)

Main Speakers / Sources

  • Main speaker: Miles Deutscher (Founder of AI Edge)
  • Primary technical sources/services referenced:
    • Claude / Anthropic (Claude code, Claude model, Claude design)
    • Whisper (audio transcription)
    • Superbase / Supabase (memory database backend)
    • Telegram (voice-note input via bot)
    • Versal (function/webhook integration)
    • Google Sheets API (live finance data)
    • Google Calendar (calendar integration)
    • BotFather (Telegram bot creation)
    • Mentions: ChatGPT/Codex, Firebase (alternative), Oura Ring / Whoop (future wearable integration)

Rate this summary

Your feedback will help improve summaries.

Improve this summary

Reprocess with a stronger model when the summary feels incomplete or inaccurate.

Pro

Translate summary in another language

Pro

Ask questions to this video

Chat for follow-up questions, clarifications, and source-backed answers.

Coming soon

Share this summary

Original video