Instructions to use Unbabel/TowerInstruct-13B-v0.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Unbabel/TowerInstruct-13B-v0.1 with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "translation" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("translation", model="Unbabel/TowerInstruct-13B-v0.1")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Unbabel/TowerInstruct-13B-v0.1") model = AutoModelForCausalLM.from_pretrained("Unbabel/TowerInstruct-13B-v0.1") - Notebooks
- Google Colab
- Kaggle
Warning during inference
#1
by vince62s - opened
Hello,
why are we getting this warning:
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
The attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's attention_mask to obtain reliable results.
Setting pad_token_id to eos_token_id:32005 for open-end generation.
does not prevent from working fine, but just asking.