Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

infosave
/
Hy4-flash-cmf

Text Generation
cortiq
English
Chinese
Russian
cmf
quantized
q4tp
q2tp
vulkan
Mixture of Experts
engram
hunyuan
hy4-flash
cuda
Model card Files Files and versions
xet
Community

Instructions to use infosave/Hy4-flash-cmf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • cortiq

    How to use infosave/Hy4-flash-cmf with cortiq:

    # one Rust binary, no additional dependencies
    cargo install cortiq-cli   # or a prebuilt binary from github.com/infosave2007/cmf/releases
    hf download infosave/Hy4-flash-cmf --include "*.cmf" --local-dir .
    ls *.cmf                   # some repos ship more than one quantization
    cortiq run FILE.cmf --prompt "What is the capital of France?"
    cortiq serve FILE.cmf --port 8080   # OpenAI-compatible server
  • Notebooks
  • Google Colab
  • Kaggle
Hy4-flash-cmf
396 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 21 commits
infosave's picture
infosave
Add README.md
0f229f5 verified about 2 hours ago
  • assets
    Add assets/perf_cuda_zh.png about 2 hours ago
  • .gitattributes
    1.69 kB
    Add hy4-flash-q2tp-sfq.cmf about 3 hours ago
  • LICENSE
    13.9 kB
    Add LICENSE about 10 hours ago
  • README.md
    21.5 kB
    Add README.md about 2 hours ago
  • hy4-flash-q2tp-sfq.cmf
    123 GB
    xet
    Add hy4-flash-q2tp-sfq.cmf about 3 hours ago
  • hy4-flash-q2tp.cmf
    123 GB
    xet
    Add hy4-flash-q2tp.cmf about 5 hours ago
  • hy4-flash-q4tp.cmf
    151 GB
    xet
    Add hy4-flash-q4tp.cmf about 10 hours ago