Key Error

#9
by dhavaltaunk08 - opened
---------------------------------------------------------------------------

KeyError                                  Traceback (most recent call last)

<ipython-input-8-0b8eac43739c> in <cell line: 6>()
      4 
      5 tokenizer = AutoTokenizer.from_pretrained("mistralai/Mistral-7B-Instruct-v0.1")
----> 6 model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-Instruct-v0.1")
      7 
      8 text = "<s>[INST] What is your favourite condiment? [/INST]"

2 frames

/usr/local/lib/python3.10/dist-packages/transformers/models/auto/configuration_auto.py in __getitem__(self, key)
    732             return self._extra_content[key]
    733         if key not in self._mapping:
--> 734             raise KeyError(key)
    735         value = self._mapping[key]
    736         module_name = model_type_to_module_name(key)

KeyError: 'mistral'

Getting the above error while trying to load the model

dhavaltaunk08 changed discussion status to closed

hey @dhavaltaunk08 you might find Impulse AI (https://www.impulselabs.ai/) useful. we make it super easy to fine-tune and deploy open source models. hopefully you find it helpful! i know not relevant to your problem above but might be easier to use us to fine tune and deploy

docs: https://docs.impulselabs.ai/introduction
python sdk: https://pypi.org/project/impulse-api-sdk-python/

Sign up or log in to comment