🤨 RuntimeError: CUDA error: the launch timed out and was terminated
HelloIt’s been several weeks since I encountered an error with Stable Diffusion on my computer (HP Z2 Mini, 16 GB of RAM). Since I updated stable diffusion with Automatic 1111, I have a “CUDA” error which prevents me from making large images (whereas before, everything worked fine).here is the detail of this error, I hope to find some help,thank you so muchGeoffreyTraceback (most recent call last):File “C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.10_3.10.3056.0_x64__qbz5n2kfra8p0\lib\threading.py”, line 1016, in _bootstrap_innerself.run()File “C:\Users\G\stable-diffusion-webui\modules\memmon.py”, line 53, in runfree, total = self.cuda_mem_get_info()File “C:\Users\G\stable-diffusion-webui\modules\memmon.py”, line 34, in cuda_mem_get_inforeturn torch.cuda.mem_get_info(index)File “C:\Users\G\stable-diffusion-webui\venv\lib\site-packages\torch\cuda\memory.py”, line 618, in mem_get_info*** Error completing request*** Arguments: (‘task(m3u61mpj738zl2g)’, ‘photo of a 30 year old German, worker,lora:epiNoiseoffset_v2:1lora:add_detail:0.8’, ‘disfigured, ugly, deformed, blur’,, 27, ‘DPM++ 2M SDE Karras’, 1, 1, 7, 800, 400, False, 0.7, 2, ‘Latent’, 0, 0, 0, ‘Use same checkpoint’, ‘Use same sampler’, ‘’, ‘’,, <gradio.routes.Request object at 0x0000029B56D9B550>, 0, False, ‘’, 0.8, False, -1, 0, 0, 0, True, False, False, ‘positive’, ‘comma’, 0, False, False, ‘’, 1, ‘’,, 0, ‘’,, 0, ‘’,, True, False, False, False, 0, False) {}return torch.cuda.cudart().cudaMemGetInfo(device)RuntimeError: CUDA error: the launch timed out and was terminatedCUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.For debugging consider passing CUDA_LAUNCH_BLOCKING=1.Compile withTORCH_USE_CUDA_DSAto enable device-side assertions.Traceback (most recent call last):
  File "C:\Users\G\stable-diffusion-webui\modules\call_queue.py", line 57, in f
    res = list(func(*args, **kwargs))
  File "C:\Users\G\stable-diffusion-webui\modules\call_queue.py", line 36, in f
    res = func(*args, **kwargs)
  File "C:\Users\G\stable-diffusion-webui\modules\txt2img.py", line 55, in txt2img
    processed = processing.process_images(p)
  File "C:\Users\G\stable-diffusion-webui\modules\processing.py", line 732, in process_images
    res = process_images_inner(p)
  File "C:\Users\G\stable-diffusion-webui\modules\processing.py", line 875, in process_images_inner
    x_samples_ddim = decode_latent_batch(p.sd_model, samples_ddim, target_device=devices.cpu, check_for_nans=True)
  File "C:\Users\G\stable-diffusion-webui\modules\processing.py", line 598, in decode_latent_batch
    devices.test_for_nans(sample, "vae")
  File "C:\Users\G\stable-diffusion-webui\modules\devices.py", line 117, in test_for_nans
    if not torch.all(torch.isnan(x)).item():
RuntimeError: CUDA error: the launch timed out and was terminated
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1.
Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions.Traceback (most recent call last):File “C:\Users\G\stable-diffusion-webui\venv\lib\site-packages\gradio\routes.py”, line 488, in run_predictoutput = await app.get_blocks().process_api(File “C:\Users\G\stable-diffusion-webui\venv\lib\site-packages\gradio\blocks.py”, line 1431, in process_apiresult = await self.call_function(File “C:\Users\G\stable-diffusion-webui\venv\lib\site-packages\gradio\blocks.py”, line 1103, in call_functionprediction = await anyio.to_thread.run_sync(File “C:\Users\G\stable-diffusion-webui\venv\lib\site-packages\anyio\to_thread.py”, line 33, in run_syncreturn await get_asynclib().run_sync_in_worker_thread(File “C:\Users\G\stable-diffusion-webui\venv\lib\site-packages\anyio_backends_asyncio.py”, line 877, in run_sync_in_worker_threadreturn await futureFile “C:\Users\G\stable-diffusion-webui\venv\lib\site-packages\anyio_backends_asyncio.py”, line 807, in runresult = context.run(func, *args)File “C:\Users\G\stable-diffusion-webui\venv\lib\site-packages\gradio\utils.py”, line 707, in wrapperresponse = f(*args, **kwargs)File “C:\Users\G\stable-diffusion-webui\modules\call_queue.py”, line 77, in fdevices.torch_gc()File “C:\Users\G\stable-diffusion-webui\modules\devices.py”, line 51, in torch_gctorch.cuda.empty_cache()File “C:\Users\G\stable-diffusion-webui\venv\lib\site-packages\torch\cuda\memory.py”, line 133, in empty_cachetorch._C._cuda_emptyCache()RuntimeError: CUDA error: the launch timed out and was terminatedCUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.For debugging consider passing CUDA_LAUNCH_BLOCKING=1.Compile withTORCH_USE_CUDA_DSAto enable device-side assertions.
2023-10-23T07:33:17Z
Hi. I am facing a similar issue. Did you find any solution?Thanks in advance