crash when run gpt with ub_tp_comm_overlap
I found that enabling ub_tp_comm_overlap will create a new mpi process group, which will cause problems. I don't know if it has something to do with the mpi version. This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days. This issue was closed because it has been inactive for 7 days since being marked as stale.
**Describe the bug**

crash when run gpt with ub_tp_comm_overlap
![image](https://github.com/NVIDIA/NeMo/assets/30709861/d15b8c2c-f266-4990-a71f-ebe1e1b9a6b0)


**Environment overview (please complete the following information)**

 - Environment location: [Bare-metal, Docker, Cloud(specify cloud provider - AWS, Azure, GCP, Collab)]
 - Method of NeMo install: [pip install or from source]. Please specify exact commands you used to install.
 - If method of install is [Docker], provide `docker pull` & `docker run` commands used

**Environment details**
PyTorch Docker: nvcr.io/nvidia/pytorch 23.10-py3

**Additional context**

Add any other context about the problem here.
Example: GPU model
