Working Notes: a commonplace notebook for recording & exploring ideas.
Home. Site Map. Subscribe. More at expLog.
A public commonplace notebook to capture notes as I learn and explore. Links are currently unstable and will change as I refactor; I'm optimizing for writing more regularly instead of spending even more time building out a blogging platform. All pages are published under the site map.
My current interests are mainly focused around learning more about building LLMs, the math around transformers and becoming deeply familiar with training dynamics.
To navigate this website: there are different kinds of pages: notes are meant for myself, taken while accumulating information; logs are a running commentary over time where I consolidate what I've been learning or working on; essays are (ideally) coherent pieces of writing meant for others to read.
Essays:
— Kunal