Why is autograd so complicated

PyTorch Developer Podcast - Een podcast door Edward Yang, Team PyTorch

Podcast artwork

Categorieën:

Why is autograd so complicated? What are the constraints and features that go into making it complicated? What's up with it being written in C++? What's with derivatives.yaml and code generation? What's going on with views and mutation? What's up with hooks and anomaly mode? What's reentrant execution? Why is it relevant to checkpointing? What's the distributed autograd engine?

Visit the podcast's native language site