This week, I learned:

    • Grab. Improving last mile delivery in maps. When did people pick up the phone, when should driver be allocated to minimize waiting time, layer on top of OSM.
    • Singapore developers the Sea Lion 7b model
    • Try VLLM with AWQ format. Can do batch inferencing. Needs a good GPU
    • Amex prediction whether they can pay back in 1 year or 18 months. That choice is a business decision. In real time. Precompute individual score and use it as input to another model. Model must be explainable by regulation. Creates decision tree models therefore. Compliance team must agree if I can use a feature. Can’t use gender. Age (in US, Canada);- high age is more risk. Can’t use edu level in the US.
    • Capture information from camera and use LLMs. Like traffic cameras mapping. Explore GIS from video cameras
    • Grab tracks road closures and road accidents and whether a cycle can go on a road vs a bike vs a car
    • All drivers have a front facing camera
    • Drivers report road accidents by pressing a button
    • Amex prices individual loans when selling to a collection agency
    • #TODO buy a bike head camera!
    • Playwright is a browser-based test framework. Supports recording.
  • OpenAI provides logprobs for tokens! This can be a used to create cool visualizations of the likelihood of the each tokens.
  • Github Copilot’s new features makes your entire workspace or a specific file its context. It also auto-writes your commit messages and PR descriptions.
  • Mixtral-8x7b-Instruct “… really does seem to be equivalent in quality to ChatGPT 3.5.” Ref
  • Practical AI podcast
    • Advent of Gen AI is going on. Explore
    • add to tools in data science course. Model validation
    • write a book as an open source to github repository. Easier to evolve and easier to get feedback on..
    • Explore utterances as a GitHub commenting platform
    • automatically give credits to contributors who have center pull request that was accepted or an issue that was fixed. This encourages contribution
    • Visit book.premai.io
  • ast-grep is a semgrep alternative that focuses on code refactoring rather than security. Comby is another such tool
  • Serply is a Google Search API alternative to Google CSE
  • ⭐ Generate textbooks!
  • ChatGPT is good at generating questions or training datasets. It genuinely creates them rather than replicating from memory. Ref
  • v0.dev creates web pages from code. Example.
  • LIDA from Microsoft is an LLM based data visualization tool.