Multi-GPU support

[YuMeng2v]

Hey guys, thanks for your great work, I wonder how to set Multi-GPU, I have realized some all reduce but look no fancy. Can you help to support Multi-GPU training and testing, thank you!

[kwuking]

Hi, in the run.py script, the parameters use_multi_gpu and devices are available for configuring multi-GPU parallel execution. Currently, the TSLib repository supports PyTorch's data parallel mode for parallel processing. If you want to use PyTorch's DDP ( Distribute Data Parallel) mode, please refer to the official DDP document for modification and adaptation.