parallelize writing of layer checkpoint files across data parallel instances#1419

Merged

tjruwase merged 13 commits intodeepspeedai:masterfrom

adammoody:layerckpt

Oct 21, 2022

Commits on Sep 20, 2022

parallelize layer checkpoints across data parallel groups
adammoody
committed

Commits on Sep 21, 2022

Commits on Sep 29, 2022

Merge branch 'master' into layerckpt
tjruwase
authored

Commits on Oct 3, 2022

Commits on Oct 4, 2022

Commits on Oct 10, 2022

Merge branch 'master' into layerckpt
tjruwase
authored

Commits on Oct 13, 2022

Merge branch 'master' into layerckpt
tjruwase
authored

Commits on Oct 18, 2022

Merge branch 'master' into layerckpt
tjruwase
authored

Commits on Oct 20, 2022

Merge branch 'master' into layerckpt
tjruwase
authored