Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
dddsaty
/
phi-4-GPTQ-8bit
like
1
Text Generation
Transformers
Safetensors
English
phi3
phi
nlp
math
code
chat
conversational
custom_code
text-generation-inference
8-bit precision
gptq
arxiv:
2412.08905
License:
mit
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
phi-4-GPTQ-8bit
/
generation_config.json
dddsaty09
Quantized Phi-4 8bit upload
a998904
about 1 year ago
raw
Copy download link
history
blame
contribute
delete
Safe
143 Bytes
{
"_from_model_config"
:
true
,
"bos_token_id"
:
100257
,
"eos_token_id"
:
[
100257
,
100265
]
,
"transformers_version"
:
"4.47.1"
}