TorchX

TorchX: A PyTorch Extension Library for More Efficient Deep Learning.

@misc{torchx,
    author = {Ansheng You and Changxu Wang},
    title = {TorchX: A PyTorch Extension Library for More Efficient Deep Learning.},
    howpublished = {\url{https://github.com/donnyyou/torchx}},
    year = {2021}
}

Memory Optimization

IO Accelerating

Communication Compression

GitHub

https://github.com/donnyyou/torchx