Question Answering
Transformers
Safetensors
English
mistral
text-generation
PEFT
sft
TensorBoard
Safetensors
trl
generated_from_trainer 4-bit
precision
text-generation-inference
4-bit precision
gptq
Instructions to use Feluda/Zephyr-7b-QnA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Feluda/Zephyr-7b-QnA with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("question-answering", model="Feluda/Zephyr-7b-QnA")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Feluda/Zephyr-7b-QnA") model = AutoModelForCausalLM.from_pretrained("Feluda/Zephyr-7b-QnA") - Notebooks
- Google Colab
- Kaggle
Ctrl+K