YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

converted to mlc_llm format using https://github.com/mlc-ai/mlc-llm

command

python build.py --model dolly-v2-12b --target vulkan --quantization-mode int4 --quantization-sym --max-seq-len 2048

not fully tested because i got "CUDA: out of memory"

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support