IsValorum/Flint-APEX-I-MiniPlus-V2.1-GGUF

Quick Navigation Index

Independently computed using dedicated cloud compute clusters, funded 100% out-of-pocket.

If you consider these releases to be of high quality and they help you in your day-to-day workflow, consider supporting on Ko-fi. Every contribution directly sustains future cloud compute hours and helps support my university studies.

1. Model Overview & Technical Specifications
2. Importance Matrix Optimization
3. Surgical Quantization Topology (779 Tensors)
4. Recommended Server & Inference Configuration
5. Community Compute Fund & Student Support

---

1. Model Overview & Technical Specifications

This repository provides Flint APEX-I-MiniPlus V2.1, a surgical high-fidelity quantization of RecursiveSI/flint.

Flint is Recursive's mixture-of-experts language model for coding agents, featuring 39.8 billion total parameters and approximately 2.5 billion active per token. It is specifically designed to investigate codebases, fix bugs, implement complex features, and write comprehensive unit tests.

The architecture features 49 layers: two initial dense SwiGLU MLP layers (blk.0 and blk.1) followed by 47 MoE layers (blk.2 to blk.48) with 256 routed micro-experts (top-k=6) and 1 shared expert. In addition, Flint incorporates learned attention sinks across all 49 layers for streaming stability over long contexts up to 262,144 tokens. The model topology encompasses exactly 779 tensors in GGUF.

MiniPlus V2.1 is engineered for uncompromising agentic coding and reasoning while respecting the strict APEX-I invariant: MiniPlus never touches 2-bit quantization. All 47 layers of routed micro-experts are preserved in 3-bit IQ3_XXS, strictly shielding routing matrices, attention sinks, and normalization layers in full 32-bit floating point (F32).

Key Characteristics

• Base Model: RecursiveSI/flint
• Architecture: FlintForCausalLM (Dense-Front + MoE + StreamingLLM Sinks)
• Total Parameters: 39.79 Billion
• Active Parameters: approx. 2.5 Billion per token
• Layers: 49 (Layers 0-1 Dense SwiGLU, Layers 2-48 MoE)
• Routed Experts: 256 per layer (Top-k = 6)
• Shared Experts: 1 per MoE layer (intermediate size 1024)
• Context Window: 262,144 tokens (Sliding Window 513 with Attention Sinks)
• GGUF Tensor Count: Exactly 779 tensors verified
• Quantization Profile: APEX-I MiniPlus V2.1 (approx. 14.70 GiB in VRAM / approx. 15.79 GB on Hub)

---

2. Importance Matrix Optimization

Quantizing a 256-expert MoE architecture without an Importance Matrix results in routing instability, expert starvation, and severe degradation in long-horizon reasoning.

This release utilizes a comprehensive Importance Matrix calibrated by Bartowski (RecursiveSI_flint-imatrix.gguf), providing full 4-moment statistical distributions across all 531 layer components:

1. First Moment / Mean Activation (.in_sum): Allows llama-quantize vector codebook optimizers (IQ3_XXS, Q4_K) to compute centered variance ($\sigma^2 = \frac{1}{N}\sum x^2 - \mu^2$) rather than uncentered raw energy, eliminating distortion on biased activations.
2. Extended Distribution Statistics (.stats [12]): Prevents outlier clipping across routed expert weights.
3. Chat-Template Aligned Calibration: Tokenized with Flint's native <|system|>...<|user|>...<|assistant|> chat template.

---

3. Surgical Quantization Topology (779 Tensors)

Every single tensor in Flint has been mapped according to the updated APEX-I V2.1 specification:

Structural Component	Tensor Count	Precision Tier	Technical Rationale
output.weight	1	Q6_K	Preserves vocabulary logit fidelity and generation nuances
output_norm.weight	1	F32	Final sequence normalization numerical shield
token_embd.weight	1	Q4_K	Robust input token embedding representation
blk.*.attn_sinks.weight	49	F32	CRITICAL: Sliding-window initial sink token stabilization
Normalizations (attn_norm, attn_q_norm, attn_k_norm, ffn_norm)	196	F32	Numerical stability and layer dynamic range protection
blk.*.ffn_gate_inp.weight (MoE Routers)	47	F32	Strictly shields gating probabilities to prevent router collapse
Dense FFN (blk.0 & blk.1: ffn_gate, ffn_up, ffn_down)	6	Q4_K / Q5_K	Robust trunk representations before MoE branching
Shared Experts (blk.*.ffn_*_shexp.weight)	141	Q4_K	Activated on 100% of tokens; critical for common knowledge
Attention Queries, Keys & Values (attn_q, attn_k, attn_v)	147	Q4_K	Multi-head attention representation
Attention Output Projections (attn_output.weight)	49	Q5_K	Context synthesis and head recombination
Routed Experts (blk.2..blk.48, all 47 layers)	141	IQ3_XXS	Strict invariant: 100% 3-bit, zero 2-bit tensors in MiniPlus
Total Verified Tensors	779	--	100% Accounting Verified

---

4. Recommended Server & Inference Configuration

Runtime Requirement

Requires llama.cpp build b11803 or higher (e.g. b11821+) which incorporates Pull Request #30928 adding native support for FlintForCausalLM and sliding-window attention sinks.

CLI Launch Command

llama-server \
  -m Flint.APEX-I-MiniPlus-V2.1.gguf \
  --host 0.0.0.0 \
  --port 8080 \
  -c 32768 \
  -ngl 99 \
  --temp 1.0 \
  --top-p 0.95 \
  --top-k 20

---

5. Community Compute Fund & Student Support

All APEX-I and VAL-APEX quantizations are produced independently using rented cloud GPU/CPU clusters and validated through tensor-level accounting.

If you find this model useful in your research or production environment, please consider supporting future releases: