DJ Sri Vigneshwar's picture
💼 Hiring

DJ Sri Vigneshwar

Sri-Vigneshwar-DJ

AI & ML interests

Co-Founder, CTO @Hawky.ai - Creative Intelligence for Performance Marketing

Recent Activity

reacted to IsValorum's post with 🔥 about 8 hours ago
Navigating the APEX-I and VAL-APEX Quantization Ecosystem on Hugging Face As the catalog approaches 400,000 total downloads across 69 releases, all models are now structured into dedicated official collections on Hugging Face. Our goal remains consistent: eliminate the compromise between memory overflow and cognitive collapse on consumer hardware (especially 16 GB VRAM GPUs like the RTX 4080, RTX 4070 Ti Super, and RX 7800 XT). Instead of uniform block quantization, all APEX builds use per-tensor mixed precision guided by 4-moment Importance Matrix statistics: - MiniPlus Tier (approx. 14 to 14.8 GiB): Strict 0% 2-bit policy. All MoE routed experts locked at minimum IQ3_XXS with Q4_K/Q6_K attention. Designed for 24 GB setups or 16 GB setups with moderate context. - NanoPlus Tier (approx. 11.5 to 12.3 GiB): Strategic use of IQ2_S/IQ2_XXS exclusively in core feedforward blocks, keeping routers and attention high-precision. Leaves ample VRAM for 16k-32k context on 16 GB GPUs. Explore the active collections: - MoE Standard (MiniPlus & NanoPlus): https://huggingface.co/collections/IsValorum/apex-i-miniplus-v21-standard-moe-6acfee77961c8c0cf5a083b5 - MoE Abliterated (MiniPlus & NanoPlus): https://huggingface.co/collections/IsValorum/apex-i-miniplus-v21-abliterated-moe-6acfee762fc4a8cf2298c55b - 27B Dense Hybrids: https://huggingface.co/collections/IsValorum/val-apex-miniplus-standard-27b-6acfec54ca4ce4cf5cd5bdb6 - Apple Silicon (MLX): https://huggingface.co/collections/IsValorum/mlx-apex-abliterated-6abedb1f9d400e984efe4fc6 Full technical article and sizing breakdown: https://huggingface.co/blog/IsValorum
View all activity

Organizations

AI FILMS's profile picture GEM benchmark's profile picture Beijing Academy of Artificial Intelligence's profile picture MusicAI's profile picture Keras Dreambooth Event's profile picture Open-Source AI Meetup's profile picture East China Normal University's profile picture AI Zero to Hero's profile picture Blog-explorers's profile picture Stable Diffusion Dreambooth Concepts Library's profile picture AI Tamil Nadu's profile picture MLX Community's profile picture LocalLLaMA's profile picture M4-ai's profile picture Cohere Labs Community's profile picture diarizers-community's profile picture Chinese LLMs on Hugging Face's profile picture Paris AI Running Club's profile picture Hawky.ai - Agentic Marketing Platform's profile picture Hawky.ai - Fine-tuned Language and Creative Generation Models (MarTech) 's profile picture Intelligent Estate's profile picture open/ acc's profile picture Data Is Better Together Contributor's profile picture Arracle AI's profile picture Taiwan Llama's profile picture LeRobot Worldwide Hackathon's profile picture Hugging Face Context Course's profile picture Desperados for Human Singularity's profile picture