John Smith's picture

In a Training Loop 🔄

John Smith PRO

John6666

·

John6666cat

AI & ML interests

None yet

Recent Activity

reacted to eaddario's post with ❤️ about 1 hour ago

Experimental global target bits‑per‑weight quantization of ServiceNow-AI/Apriel-1.6-15b-Thinker and zai-org/GLM-4.6V-Flash Unlike standard llama.cpp quantizations that rely on fixed type heuristics (e.g., Q4_K_M), the Target BPW approach optimizes per-tensor precision where it matters the most, and produces high quality models that meet a precise global file size target. Key Advantages: - VRAM Maximization: Can generate high quality models sized exactly to fit hardware constraints (e.g., fitting the model into exactly 24GB VRAM). - Data-Driven Precision: Quantization mix is determined by actual weight error sensitivity rather than hardcoded rules, often yielding better PPL/KLD size trade-offs. Full benchmarks (PPL, KLD, ARC, MMLU, etc.) and methodology in the models' cards https://huggingface.co/eaddario/Apriel-1.6-15b-Thinker-GGUF https://huggingface.co/eaddario/GLM-4.6V-Flash-GGUF

upvoted a collection about 1 hour ago

Arabic Speech Datasets

reacted to MohamedRashad's post with ❤️ about 1 hour ago

I have update my https://huggingface.co/collections/MohamedRashad/arabic-speech-datasets with new datasets, making the full audio data more than 3000 hours of good arabic speech. Feel Free to use it in your new innovations, And happy new year!

View all activity

Organizations

John6666 's collections 18