Text Generation
cortiq
English
Chinese
Russian
cmf
quantized
q4tp
q2tp
vulkan
Mixture of Experts
engram
hunyuan
hy4-flash
cuda
Instructions to use infosave/Hy4-flash-cmf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- cortiq
How to use infosave/Hy4-flash-cmf with cortiq:
# one Rust binary, no additional dependencies cargo install cortiq-cli # or a prebuilt binary from github.com/infosave2007/cmf/releases hf download infosave/Hy4-flash-cmf --include "*.cmf" --local-dir . ls *.cmf # some repos ship more than one quantization
cortiq run FILE.cmf --prompt "What is the capital of France?"
cortiq serve FILE.cmf --port 8080 # OpenAI-compatible server
- Notebooks
- Google Colab
- Kaggle
Commit History
Today
-
Add README.md
Verified signature0f229f5 -
Add assets/perf_cuda_zh.png
Verified signature50dcb2b -
Add assets/perf_cuda_ru.png
Verified signature95a33b8 -
Add assets/perf_cuda_en.png
Verified signature0d62836 -
Add README.md
Verified signature23cc877 -
Add assets/perf_cuda_zh.png
Verified signature5d8fc44 -
Add assets/perf_cuda_ru.png
Verified signature231fa35 -
Add assets/perf_cuda_en.png
Verified signatureb66ed47 -
Add README.md
Verified signature6966c67 -
Add assets/perf_cuda_zh.png
Verified signature89dec06 -
Add assets/perf_cuda_ru.png
Verified signatureb5f95ca -
Add assets/perf_cuda_en.png
Verified signature743b5bb -
Add hy4-flash-q2tp-sfq.cmf
Verified signature1ae0b05 -
Add README.md
Verified signature051b941 -
Add assets/perf_cuda_zh.png
Verified signature6812574 -
Add assets/perf_cuda_ru.png
Verified signature97c1fa8 -
Add assets/perf_cuda_en.png
Verified signatureb01e619 -
Add hy4-flash-q2tp.cmf
Verified signatureb2aebcc -
Add hy4-flash-q4tp.cmf
Verified signature55bace8
Yesterday
-
Add LICENSE
Verified signature298b228 -
initial commit
Verified signature60467d8