This week, I learned:

  • Assisted generation uses a faster LLM to generate text and a better (tokenizer-compatible) LLM to validate it. This makes it faster. E.g. Gemma 2 2b with Gemma 2 27b
  • Power Toys has an Advanced Paste that uses OpenAI to paste as Markdown or JSON!
  • Interest Turing complete languages:
  • Rev.ai does a good job of diarization. Cost: 2 cents per minute. Update: 6 Jun 2025. Cost: 0.33c/min Ref