NVIDIA Nemotron 3 family — NemotronH architecture combining Mamba state-space + standard attention. Mac-runnable, BatiAI-quantized + signed.
AI & ML interests
On-device AI, GGUF quantization, Apple Silicon, macOS automation
Recent Activity
View all activity
Latest Qwen 3.6 series with native tool calling, thinking mode, and Vision-Language. Best balance for 48-128GB Macs.
Qwen 3.5 dense and MoE quantizations. Reliable tool calling and JSON generation.
Largest open-weight LLMs, BatiAI-quantized. Mac-runnable from M4 Max 128GB to Mac Studio M3 Ultra 512GB.
Gemma 4 quantizations from Google's official weights. Best entry for 16GB Mac mini M4 (E4B Q4 = 57 t/s).
Complete Mac-first on-device RAG stack — chat LLM + reranker + text/VL embedder, direct from BF16, BatiAI-signed. For BatiFlow.
-
batiai/Qwen3-Embedding-4B-GGUF
Sentence Similarity • 4B • Updated • 119 -
batiai/Qwen3-Embedding-0.6B-GGUF
Sentence Similarity • 0.6B • Updated • 180 • 1 -
batiai/Qwen3-VL-Embedding-8B-GGUF
Sentence Similarity • 8B • Updated • 1.85k • 6 -
batiai/Qwen3-VL-Embedding-2B-GGUF
Sentence Similarity • 2B • Updated • 294
NVIDIA Nemotron 3 family — NemotronH architecture combining Mamba state-space + standard attention. Mac-runnable, BatiAI-quantized + signed.
Largest open-weight LLMs, BatiAI-quantized. Mac-runnable from M4 Max 128GB to Mac Studio M3 Ultra 512GB.
Latest Qwen 3.6 series with native tool calling, thinking mode, and Vision-Language. Best balance for 48-128GB Macs.
Gemma 4 quantizations from Google's official weights. Best entry for 16GB Mac mini M4 (E4B Q4 = 57 t/s).
Qwen 3.5 dense and MoE quantizations. Reliable tool calling and JSON generation.
Complete Mac-first on-device RAG stack — chat LLM + reranker + text/VL embedder, direct from BF16, BatiAI-signed. For BatiFlow.
-
batiai/Qwen3-Embedding-4B-GGUF
Sentence Similarity • 4B • Updated • 119 -
batiai/Qwen3-Embedding-0.6B-GGUF
Sentence Similarity • 0.6B • Updated • 180 • 1 -
batiai/Qwen3-VL-Embedding-8B-GGUF
Sentence Similarity • 8B • Updated • 1.85k • 6 -
batiai/Qwen3-VL-Embedding-2B-GGUF
Sentence Similarity • 2B • Updated • 294