README.md

metadata

tags:
  - uqff
  - mistral.rs
base_model: alecccdd/ttds-det-analyse
base_model_relation: quantized

alecccdd/ttds-det-analyse, UQFF quantization

Run with mistral.rs. Documentation: UQFF docs.

1. Flexible: Multiple quantization formats in one file format with one framework to run them all.
2. Reliable: Compatibility ensured with embedded and checked semantic versioning information from day 1.
3. Easy: Download UQFF models easily and quickly from Hugging Face, or use a local file.
4. Customizable: Make and publish your own UQFF files in minutes.

Examples

Quantization	Command
AFQ4	mistralrs run -m alecccdd/alecccddttds-det-analyse-UQFF vision-plain --from-uqff afq4-0.uqff
FP8	mistralrs run -m alecccdd/alecccddttds-det-analyse-UQFF vision-plain --from-uqff fp8-0.uqff
Q4K	mistralrs run -m alecccdd/alecccddttds-det-analyse-UQFF vision-plain --from-uqff q4k-0.uqff