rahit/repro-amdp-asynchronous-multi-directional-pipeline-parallelism-for-large-scale-models-training

Reproduction: AMDP: Asynchronous Multi-Directional Pipeline Parallelism for Large-Scale Models Training

An open experiment logbook, published with Trackio.