add support for distributed data parallel training#116

Merged

atong01 merged 11 commits intoatong01:mainfrom ImahnShekhzadeh:main

Aug 21, 2024

+252-8

Commits on May 19, 2024

make code changes in train_cifar10.py to allow DDP (distributed data parallel)
ImahnShekhzadeh
committed
add instructions to README on how to run cifar10 image generation code on multiple GPUs
ImahnShekhzadeh
committed
fix: when running cifar10 image generation on multiple gpus, use rank for device setting
ImahnShekhzadeh
committed

Commits on May 20, 2024

fix: load checkpoint on right device
ImahnShekhzadeh
committed

Commits on Aug 8, 2024