Working Notes: a commonplace notebook for recording & exploring ideas.
Home. Site Map. Subscribe. More at expLog. — Kunal

Torch Dispatch

This should be very useful for building tools with pytorch, particularly if it supports jit scripting.

TorchDispatchMode

• https://dev-discuss.pytorch.org/t/torchdispatchmode-for-debugging-testing-and-more/717

Background

• https://dev-discuss.pytorch.org/t/what-and-why-is-torch-dispatch/557
• https://dev-discuss.pytorch.org/t/the-ideal-pytorch-flop-counter-with-torch-dispatch/505

Questions

• Will this work around a jit-scripted model
• What all can I get from this?
• labels, graph, editing, dynamic instrumentation

• notes/pytorch_torchscript
• notes/pytorch
• notes/torch
• notes/exploratory_programming
• notes/parallel_programming/parallel_programming
• notes/ml_debugging
• notes/gpumode/001_profilecuda
• notes/tools_for_thought
• notes/amazon_sagemaker_debugger
• notes/transformers/flashattn