Task not inferred by the model
#3
by
dferguson992
- opened
I'm trying to deploy this model onto a sagemaker endpoint using the LMI container image, but I keep getting the same error "task not inferred by the model"
I have the HF_TASK environment variable set in my model configuration, but it doesn't seem to be reading it.
I'm using the AutoModelForCausalLM class to deploy it. Any tips or tricks here?