RuntimeError: cusolver error: CUSOLVER_STATUS_NOT_INITIALIZED, when calling `cusolverDnCreate(handle)
Using `torch.backends.cudnn.enabled = False` before model.diarize() solves the issue temporarily
 This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days. This issue was closed because it has been inactive for 7 days since being marked as stale.
I am facing 
`RuntimeError: cusolver error: CUSOLVER_STATUS_NOT_INITIALIZED, when calling cusolverDnCreate(handle)
`

I am getting this issue while running the msdd_model.diarize() function, I have checked my GPU and it has enough space to run the file.

I saw the same issue in https://github.com/PanQiWei/AutoGPTQ/issues/478, but in my case there is no AutoGPTQ. It is occuring when I run the line msdd_model.diarize().
My Cuda and Pytorch versions are these:
Cuda version 11.7 (Cuda compilation tools, release 11.7, V11.7.99)
Pytorch Version -2.0.1+cu117


A clear and concise description of what the bug is.

Description
I encountered a RuntimeError: cusolver error: CUSOLVER_STATUS_NOT_INITIALIZED when calling cusolverDnCreate(handle) while running the msdd_model.diarize() function.

Steps to Reproduce

from nemo.collections.asr.models import NeuralDiarizer
from nemo.collections.asr.models.msdd_models import create_config

msdd_model = NeuralDiarizer(cfg=create_config(temp_path)).to("cuda")

msdd_model.diarize()


**Expected behavior**

I expected the msdd_model.diarize() function to run without errors.


**Environment overview (please complete the following information)**

Environment Location: JupyterHub
Method of NeMo Install: pip install
Commands Used for Installation: `!pip install --no-build-isolation nemo_toolkit[asr]==1.21.0 --user`
OS Version: Linux 5.4.254-170.358.amzn2.x86_64
PyTorch Version: 2.0.1+cu117
Python Version: 3.10
GPU Model: NVIDIA A10G

**Environment details**
Ensure that the GPU has enough space.
CUDA Version: 11.7 (Cuda compilation tools, release 11.7, V11.7.99)

**Additional context**

Additional Context
I saw a similar issue reported in [GitHub Issue #478](https://github.com/PanQiWei/AutoGPTQ/issues/478), but my case does not involve AutoGPTQ. The error occurs specifically when running the msdd_model.diarize() function.
