Things I Learned - 12 Nov 2023

I discovered Julius.ai for data queries and AutoGen for multi-agent systems. I also explored high-performance LLM inference using vLLM and DeepSpeed, alongside architectural patterns and critiques of the Foundation Model Transparency Index.

Sun, 12 Nov 2023 • Things I learned

This week, I learned:

Julius.ai queries structured data.
TODO: Explore https://github.com/microsoft/TaskMatrix
microsoft/autogen enables multi-agent conversations.
Architecture of today’s LLMs is similar to the A16Z architecture
Stanford Foundational Model Transparency index was critiqued as misleading
vLLM runs HuggingFace transformers models faster. So does DeepSpeed