alecccdd/ttds-det-analyse, UQFF quantization

Run with mistral.rs. Documentation: UQFF docs.

  1. Flexible: Multiple quantization formats in one file format with one framework to run them all.
  2. Reliable: Compatibility ensured with embedded and checked semantic versioning information from day 1.
  3. Easy: Download UQFF models easily and quickly from Hugging Face, or use a local file.
  4. Customizable: Make and publish your own UQFF files in minutes.

Examples

Quantization Command
AFQ4 mistralrs run -m alecccdd/alecccddttds-det-analyse-UQFF vision-plain --from-uqff afq4-0.uqff
FP8 mistralrs run -m alecccdd/alecccddttds-det-analyse-UQFF vision-plain --from-uqff fp8-0.uqff
Q4K mistralrs run -m alecccdd/alecccddttds-det-analyse-UQFF vision-plain --from-uqff q4k-0.uqff
Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for alecccdd/alecccddttds-det-analyse-UQFF