Things I Learned - 04 Aug 2024
This week, I learned: Assisted generation uses a faster LLM to generate text and a better (tokenizer-compatible) LLM to validate it. This makes it faster. E.g. Gemma 2 2b with Gemma 2 27b Power Toys has an Advanced Paste that uses OpenAI to paste as Markdown or JSON! Interest Turing complete languages: find + mkdir, maybe sed and awk Minecraft’s Redstone Circuits Conway’s Game of Life Cellular Automata Rule 110 Magic: The Gathering SQL Excel Rev.ai does a good job of diarization. Cost: 2 cents per minute. Update: 6 Jun 2025. Cost: 0.33c/min Ref