Skip to content

A PyTorch extension that facilitates decentralized data parallel training

License

Notifications You must be signed in to change notification settings

WangZesen/Decent-DP

Repository files navigation

Decentralized Data Parallel (Decent-DP)

Documentation

Introduction

The package is an PyTorch extension that faciliates efficient multi-worker decentralized data parallel training which fits in certain algorithm schemas.

Icon created by zero_wing - Flaticon

About

A PyTorch extension that facilitates decentralized data parallel training

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages