Cuda OutOfMemory issue when following Colab tutorial
Hi,
I am trying to follow the tutorial at: [Speaker_Identification_Verification.ipynb](https://github.com/NVIDIA/NeMo/blob/main/tutorials/speaker_tasks/Speaker_Identification_Verification.ipynb)

I create a new Colab environment with 15GB GPU attached and run all of the cells in that sheet. It runs until cell 21, which is the command:
`trainer.fit(speaker_model)`

That is where I get this error:
`OutOfMemoryError: CUDA out of memory. Tried to allocate 468.00 MiB (GPU 0; 14.76 GiB total capacity; 13.17 GiB already allocated; 47.88 MiB free; 13.59 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation.  See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF`