Working Notes: a commonplace notebook for recording & exploring ideas.
Home. Site Map. Subscribe. More at expLog.
— Kunal
This is exciting.
I don't want to do any of this in a pure notebook interface, so I'm exploring if I can use my personal laptop with a tiny gpu, runpod or something else to do the homework: so far using my laptop seems to be sufficient.
Set up:
git subtree to have the repos laid out in a single major repositorygit remote add hw0 git@github.com:dlsyscourse/hw0.git
git subtree add --prefix=hw0 hw0 main --squash
uv pip install numpy jupyter pybind11 numdifftools mugrade pytest
uv pip install --upgrade --no-deps git+https://github.com/dlsyscourse/mugrade.git
Having the source code checked out meant I don't need to bother with setup scripts.
Tested with the add function implemented and pytest.
parse_mnist was fun enough to do, though yann's links don't seem to work anymore
the softmax_loss was confusing till gemini pointed that it was just the expanded version
not familiar enough with numpy's advanced indexing
softmax epoching made sense with the video
Doing calculations manually in C++ was pretty painful and tricky, but it's a good exercise to be able to structure & visualize matmuls in my head.