Skip to content

About

The network simulation of hybrid Data parallelism and Pipeline parallelism for CollScope.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

22 Commits

Folders and files

Repository files navigation

CollScope

To facilitate further research, we have open-sourced the CollScope prototype for our paper: CollScope: Dynamic Training Semantic Alignment for Non-Intrusive Straggler Diagnosis, including our eBPF-based tracking suite, the core algorithms for end-to-end anomaly detection, delimitation, localization, and the simulation code for hybrid-dppp implemented with the Discrete Event Network Simulator.

Structure

Structure

.
|-- CollScope-NS3               # The NS3 simulator for network side hybrid collective communication.
|-- README.md                       
|-- dockerfile                  # Dockerfile for Network Simulation.
|-- eBPF                        # ebpf detectors.
|-- hook_output                 # The hook_output for network simulations.
`-- straggler-algorithms        # The Core Straggler Algorithms.

Citation

[TBD]...

About

The network simulation of hybrid Data parallelism and Pipeline parallelism for CollScope.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Used by

Contributors

Languages