Hugging Face's logo

alexpaul
/
QI-Large-v1

Text Generation
Transformers
PyTorch
English
llama
code
music
finance
text-generation-inference
8-bit precision
Model card Files
xet
 Community
1
How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="alexpaul/QI-Large-v1")
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("alexpaul/QI-Large-v1")
model = AutoModelForCausalLM.from_pretrained("alexpaul/QI-Large-v1", device_map="auto")
Quick Links

Run the Model

tokenizer = LlamaTokenizer.from_pretrained("alexpaul/QI-large-v1")

base_model = LlamaForCausalLM.from_pretrained(
    "alexpaul/QI-large-v1",
    load_in_8bit=True,
    device_map='auto',
)
Downloads last month
10
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Datasets used to train alexpaul/QI-Large-v1

Space using alexpaul/QI-Large-v1 1