This week, I learned:

  • Modal.com seems of offer reasonably priced GPUs
  • Combining vector search and keyword search with reciprocal rank fusion seems to work well for RAG. Ref
  • Knowledge Project podcast. Morgan Housel
    • Differences of opinion exist because of different stories arising from origins and experiences. We are not debating facts. We are debating life lessons!
    • Solution: hear their anecdotes. The stories that taught them their lessons.
  • AI reporting templates are a trend. Domain expertise comes in via structuring the report template and associated prompts.
  • Some audio embedding models: unoti/voice-embeddings, retkowsky/audio_embeddings, pyannote/embedding (for speaker similarity), and more.
  • Hidden Brain podcast: Innovation 2.0: The power of less
    • Subtraction is hard because we are biologically and economically wired against it. It’s also hard because there are fewer markers of subtraction. Additions are natural markers / triggers.
    • Marie Kondo suggests keeping only what sparks joy
  • #POST I tried Undermind.ai - an agent that researches for you. It guides you to ask a detailed question, spends 2-3 minutes finding the answer, and provides detailed results. But it’s worth the wait. It’s a good alternative to quick validations on SciSpace.
  • For popular results, search actually makes results worse! When not to trust language models
  • Perception of fluency and usefulness are NEGATIVELY correlated in LLM! Evaluating Verifiability in Generative Search Engines
  • GPTs are now available to non paying users. Apparently for a few weeks! Everyone also has limited access to GPT-4o.
  • Discussion with Anand
    • Explore BBC Microbit
    • Everyone should get a Raspberry Pi!
    • Watch 2 minutes paper on YouTube
  • More LLM routers:
    • LiteLLM: Open source, OpenAI compatible, 100+ LLMs
    • RouteLLM: Open source, OpenAI compatible, automatically routes based on cost
    • OpenRouter: OpenAI compatible API, several models
    • Unify: Supports many models
    • Portkey: Supports popular providers
    • Martian: Limited set of models
  • d-id and Heygen can modify videos of a person.