Deploying to Model Hub for Inference with custom tokenizer
Hello everyone, I have a working model for a text generation task and I would to use the huggingface Inference API to simplify calling this model to generate new text. However I used a custom WordLevel tokenizer due to the nature of my domain and the docs aren’t very clear on how I would make this work since I didn’t use aPretrainedTokenizer. Does anyone have any sort of documentation or reference on how I can still leverage the Inference API or if this is possible? Currently with my model deployed on Model Hub I receive aroute not foundwhen attempting to call with example text in following the example hereOverview — Api inference documentation.
2022-01-01T04:03:31Z
@jodiakDid you ever find a solution to this?