Key Error
#9
by
dhavaltaunk08
- opened
---------------------------------------------------------------------------
KeyError Traceback (most recent call last)
<ipython-input-8-0b8eac43739c> in <cell line: 6>()
4
5 tokenizer = AutoTokenizer.from_pretrained("mistralai/Mistral-7B-Instruct-v0.1")
----> 6 model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-Instruct-v0.1")
7
8 text = "<s>[INST] What is your favourite condiment? [/INST]"
2 frames
/usr/local/lib/python3.10/dist-packages/transformers/models/auto/configuration_auto.py in __getitem__(self, key)
732 return self._extra_content[key]
733 if key not in self._mapping:
--> 734 raise KeyError(key)
735 value = self._mapping[key]
736 module_name = model_type_to_module_name(key)
KeyError: 'mistral'
Getting the above error while trying to load the model
dhavaltaunk08
changed discussion status to
closed
hey @dhavaltaunk08 you might find Impulse AI (https://www.impulselabs.ai/) useful. we make it super easy to fine-tune and deploy open source models. hopefully you find it helpful! i know not relevant to your problem above but might be easier to use us to fine tune and deploy
docs: https://docs.impulselabs.ai/introduction
python sdk: https://pypi.org/project/impulse-api-sdk-python/