Hugging Face's logo

ghost613
/
gemma-ko-2b-AWQ

Text Generation
Transformers
Safetensors
PyTorch
Korean
English
gemma
text-generation-inference
4-bit precision
awq
Model card Files
xet
 Community
How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="ghost613/gemma-ko-2b-AWQ")
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("ghost613/gemma-ko-2b-AWQ")
model = AutoModelForCausalLM.from_pretrained("ghost613/gemma-ko-2b-AWQ")
Quick Links

Gemma-Ko

Quantized model from: Gemma Ko
Original Gemma Model Page: Gemma

This model card corresponds to the 2B base version of the Gemma-Ko model.

Resources and Technical Documentation:

Terms of Use: Terms

Downloads last month
3
Safetensors
Model size
3B params
Tensor type
I32
·
F16
·
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including ghost613/gemma-ko-2b-AWQ