Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon (no PyTorch, no cloud). Try the LabAll OptiQ quantsDocs

Downloads last month
21
Safetensors
Model size
0.8B params
Tensor type
BF16
U32
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for nisavid/MemReranker-4B-OptiQ-4bit

Quantized
(1)
this model