This wiki site will be offline Thursday, Oct 5th, 2023, from 0600 to 0830 in order to upgrade Confluence
ImageNet Distributed Mixed-precision Training Benchmark
...
Github repo for all source code and details: https://github.com/richardkxu/distributed-pytorch
Jupyter notebook tutorial for the key points: https://github.com/richardkxu/distributed-pytorch/blob/master/ddp_apex_tutorial.ipynb
HAL paper: coming up soon!
...