Difference between `world_size` and `n_gpu`
Hi!  I tried to look for this but haven’t figured out some definite explanations.  What’s the difference between these two?  I’m mainly using DDP on one node (multiple machines), so it seemsworld_sizeis the actual#gpu, andn_gpuis always 1.  Then what isn_gpuused for?  Thanks!