Tagged: Speech

Articles

• Multimodal · Part 1Images, Speech & Video

  How AI Sees, Hears and Draws: Everything Becomes Tokens

  Images, audio and video all become sequences of vectors before a transformer sees them: a measured token ledger across eight open models and Claude.

• Multimodal · Part 9Images, Speech & Video

  Speech Recognition with Whisper: From Waveform to Words

  How Whisper turns sound into a log-mel spectrogram and then into text, and what word error rate, noise and silence do to it, measured on a laptop GPU.

• Multimodal · Part 10Images, Speech & Video

  Text-to-Speech: How a Model Learns to Read Aloud

  Text normalization, phonemes, duration, pitch and a waveform: how modern text-to-speech works, with Kokoro-82M timed and its intelligibility measured.

• Multimodal · Part 11Images, Speech & Video

  Audio Tokens and Voice Agents: Codecs, Turn-Taking and Latency

  How neural codecs turn speech into tokens, how speech-to-speech models work, and where a voice agent's latency goes, measured stage by stage on a laptop.