INTELLECT-3-REAP-50-GGUF

This model was converted to GGUF format from 0xSero/INTELLECT-3-REAP-50 using GGUF Forge.

Quants

The following quants are available: Q2_K, Q3_K_S, Q3_K_M, Q3_K_L, Q4_0, Q4_K_M, Q5_0, Q5_K_S, Q5_K_M, Q6_K, Q8_0

Conversion Stats

Metric Value
Job ID 80462396-c33d-4839-ab4f-6f03b98a5025
GGUF Forge Version v4.2
Total Time 3.1h
Avg Time per Quant 6.7min

Step Breakdown

  • Download: 23.3min
  • FP16 Conversion: 18.8min
  • Quantization: 2.4h

πŸš€ Convert Your Own Models

Want to convert more models to GGUF?

πŸ‘‰ gguforge.com β€” Free hosted GGUF conversion service. Login with HuggingFace and request conversions instantly!

Links

  • 🌐 Free Hosted Service: gguforge.com
  • πŸ› οΈ Self-host GGUF Forge: GitHub
  • πŸ“¦ llama.cpp (quantization engine): GitHub
  • πŸ’¬ Community & Support: Discord

Converted automatically by GGUF Forge v4.2

Downloads last month
868
GGUF
Model size
57B params
Architecture
glm4moe
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for Akicou/INTELLECT-3-REAP-50-GGUF

Quantized
(2)
this model

Collection including Akicou/INTELLECT-3-REAP-50-GGUF