Working Notes: a commonplace notebook for recording & exploring ideas.
Home. Site Map. Subscribe. More at expLog.
— Kunal
LLM related projects I want to try
- minimal llm model that predicts look and say with a small context window to build intuition
- see how many layers it takes to do it right
- try other patterns too
- implement with numpy/jax
- read and interact with full laptop, also use voice
- have a small llm that interacts with the web and googles & summarizes for me
- train an llm from scratch for a purpose
- train an english only llm
- extract a program from an llm
- social media, hacker news consumer and summarizer
- cli command generator that understands history, man pages, locally run help, etc.
- compose UIs using LLM results (webpage + llm to extract contents)