Add data distributed training capabilities.

[truskovskiyk]

There is no good & easy-to-start end-to-end distributed training example on the web. Plus, there are so many ways of doing this: via raw PyTorch, via Ray Train, via TorchX, via Accelerate or via DeepSpeed.

How could I do this with toolkit?