Cuda Error with Zero Space
Hello Community,i developed a local rag pipeline with a model for embeddings, reranking and a LLM for inference. Locally everything works just fine, but I cant get to run it in my zero space.The Error i get is:Traceback (most recent call last):File “/home/user/app/app.py”, line 1, inimport spacesFile “/usr/local/lib/python3.10/site-packages/spaces/init.py”, line 19, infrom .zero.decorator import GPUFile “/usr/local/lib/python3.10/site-packages/spaces/zero/init.py”, line 15, inraise RuntimeError(RuntimeError: CUDA has been initialized before importing thespacespackageYou can find my space here:huggingface.coPrototypGrundschutzChatbot - a Hugging Face Space by MikeMannPrototypGrundschutzChatbotDo you have any hints for me?Thank you in advance!
2024-12-11T09:33:09Z
Fix seemed to be that I needed to disable CUDA before importing spaces.
2024-12-11T21:33:13Z
This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.