Always get RuntimeError: CUDA out of memory. Tried to allocate XX.XX MiB
**Describe the bug**
I am trying to train a TTS model. I followed the steps of the documentation but still cannot train the model.
I always get RuntimeError: Cuda out of memory. So the program crash.

**Steps/Code to reproduce bug**

The way to reproduce the error is to execute this command from the console in a linux:
python3 tacotron2.py sample_rate=22050 train_dataset=files.json validation_datasets=files.json trainer.max_epochs=1 trainer.accelerator=null trainer.check_val_every_n_epoch=1

The file tacotron2.py is the next:
https://github.com/NVIDIA/NeMo/blob/main/examples/tts/tacotron2.py

The config file for tacotron2.py is https://github.com/NVIDIA/NeMo/blob/main/examples/tts/conf/tacotron2.yaml

I edited tacotron2.yaml in my computer to reduce the batch_size and num_workers
The values are:
batch_size=1
num_workers=1

So, I reduced the batch_size to the minium to try to avoid the cuda error with No success.

The file "files.json":
I started with 100.000 lines. Each line like this: (I mean the file is written as explained in the documentation)
{"audio_filepath": "4da6b70e-0108-4f75-80ae-3d71f1dd2c2b.wav", "text": "y aquí en dos palotadas hemos encontrado robustas columnas donde apoyar la grandiosa fábrica de su alcurnia", "duration": 6.84}

I tried to train the model reducing the number of lines. I Started with 100000. Then I reduced to the file "files.json" to only 100. Unfortunately, it crashed as well..

**Expected behavior**

I would like to find a way to train a TTS model managing properly the GPU memory.

**Environment overview**

Computer: MSI Apache Pro GE70 - 2PE
Operating system: Ubuntu 20.04.3 LTS
GPU: NVIDIA GTX 860 (2GB)
nemo-toolkit                  1.5.1               
pytorch-lightning             1.5.7               
torch                         1.10.1              
torch-stft                    0.1.4               
torchaudio                    0.10.1+cu102        
torchmetrics                  0.6.2               
torchvision                   0.11.2+cu102   


Could you help me to solve it?

Thank you!
