Hugging Face's logo

solidrust
/
Nutopia-7B-AWQ

Text Generation
Transformers
Safetensors
mistral
mergekit
Merge
4-bit precision
AWQ
text-generation-inference
awq
Model card Files
xet
 Community
How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="solidrust/Nutopia-7B-AWQ")
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("solidrust/Nutopia-7B-AWQ")
model = AutoModelForCausalLM.from_pretrained("solidrust/Nutopia-7B-AWQ")
Quick Links

Alsebay/Nutopia-7B AWQ

Model Summary

Testing purpose only, seem it not good in Roleplaying 😢

This model was merged using the SLERP merge method.

The following models were included in the merge:

Downloads last month
6
Safetensors
Model size
7B params
Tensor type
I32
·
F16
·
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including solidrust/Nutopia-7B-AWQ