Deploying LLaVA model on amazon EC2
I tried to deploy the model on EC2 and I got the error below.image1418×93 5.35 KB
2023-12-21T09:27:34Z
Hi,One should not use theTFAutoModelForCausalLMclass for loading LLaVa, one should use theAutoModelForVision2Seqclass (or equivalently, theLlavaForConditionalGenerationclass) instead.Could you try that?