Things I Learned - 02 Jun 2024
This week, I learned: Modal.com seems of offer reasonably priced GPUs Combining vector search and keyword search with reciprocal rank fusion seems to work well for RAG. Ref Knowledge Project podcast. Morgan Housel Differences of opinion exist because of different stories arising from origins and experiences. We are not debating facts. We are debating life lessons! Solution: hear their anecdotes. The stories that taught them their lessons. AI reporting templates are a trend. Domain expertise comes in via structuring the report template and associated prompts. Some audio embedding models: unoti/voice-embeddings, retkowsky/audio_embeddings, pyannote/embedding (for speaker similarity), and more. Hidden Brain podcast: Innovation 2.0: The power of less Subtraction is hard because we are biologically and economically wired against it. It’s also hard because there are fewer markers of subtraction. Additions are natural markers / triggers. Marie Kondo suggests keeping only what sparks joy #POST I tried Undermind.ai - an agent that researches for you. It guides you to ask a detailed question, spends 2-3 minutes finding the answer, and provides detailed results. But it’s worth the wait. It’s a good alternative to quick validations on SciSpace. For popular results, search actually makes results worse! When not to trust language models Perception of fluency and usefulness are NEGATIVELY correlated in LLM! Evaluating Verifiability in Generative Search Engines GPTs are now available to non paying users. Apparently for a few weeks! Everyone also has limited access to GPT-4o. Discussion with Anand Explore BBC Microbit Everyone should get a Raspberry Pi! Watch 2 minutes paper on YouTube More LLM routers: LiteLLM: Open source, OpenAI compatible, 100+ LLMs RouteLLM: Open source, OpenAI compatible, automatically routes based on cost OpenRouter: OpenAI compatible API, several models Unify: Supports many models Portkey: Supports popular providers Martian: Limited set of models d-id and Heygen can modify videos of a person.