This week, I learned:
- Tough prompt to test:
Gr brx vshdn Fdhvdu flskhu?is a quick way to assess LLM capability. Ref - Cheap cloud GPU services thread on Twitter lists:
- Runpod (17)
- Vast.ai (17)
- Modal Labs (8)
- fly.io (4)
- LightningAI (4)
- Colab (4)
- AkashNet (4)
- Lambda Labs (4)
- ShadeFormAI (3)
- Mac Mini (3)
- Tensor Dock (2)
- Hetzner (2)
- BrevDev (2)
- JSR lets you publish Deno packages that can be imported by npm via. It also auto-evaluates documentation and scores it! via
- Snowflake Arctic Cookbook explains how mixture of experts models work
- A long list of LLM courses online
- Embeddings can be averaged. So, to embed large documents, average the embeddings of their chunks! OpenAI suggests this.