Tagged: Multimodal

Articles

• Fundamentals · Part 15How LLMs Work

  Multimodal Models: How LLMs See and Hear

  How images, video and audio become vectors an LLM can read: ViT patches, CLIP, LLaVA-style projectors, Whisper and audio codec tokens, with real numbers.