SLM-SQL GGUF
Collection
GGUF Q4_K_M quantizations of SLM-SQL models for text-to-SQL with llama.cpp. Based on: https://arxiv.org/abs/2507.22478 • 12 items • Updated
SLM-SQL-Base-0.6B GGUF
GGUF quantized version of cycloneboy/SLM-SQL-Base-0.6B.
Quantization: Q4_K_M
Usage
llama-server -m slm-sql-base-0.6b-q4_k_m.gguf --port 8081
Source
- Paper: SLM-SQL: An Exploration of Small Language Models for Text-to-SQL
- Original model: cycloneboy/SLM-SQL-Base-0.6B
- Downloads last month
- 19
Hardware compatibility
Log In to add your hardware
4-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for frizynn/SLM-SQL-Base-0.6B-GGUF
Base model
cycloneboy/SLM-SQL-Base-0.6B