Hugging Face's logo

microsoft
/
Phi-3-mini-4k-instruct-onnx-web

Text Generation
Transformers.js
ONNX
Transformers
phi3
ONNX
ONNXRuntime
ONNXRuntimeWeb
nlp
conversational
custom_code
Model card Files
xet
Community
4

Update Transformers.js config to use fp16 kv cache for q4f16 model

#3
by Xenova HF Staff - opened
base: refs/heads/main
←
from: refs/pr/3
Discussion Files changed
+40
-34
Xenova
No description provided.
Update config.json3ef1992e
Xenova changed pull request title from Update config.json to Update Transformers.js config to use fp16 kv cache for q4f16 model
Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment