Help with custom handler.py for model inference endpoint
Hey Everyone!I am having an issue where the custom endpoint I am creating on Hugging Face does not reflect the handler.py file that I have uploaded.huggingface.codgunzy/capstone-t5-flan-summerizer at mainWe’re on a journey to advance and democratize artificial intelligence through open source and open science.This is my model, and I have put the handler.py in the project root. When I create a new inference endpoint the documentation suggests (Create custom Inference Handler)  that it will be detected and used, but I am not having any success. I am very new to this so any other suggestions are appreciated!
2024-02-24T11:56:13Z
Looks like the container type has to be set to “Default”, not Text Generation. My mistake!