How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf ProprietaryLegal/MiniMax-2.7-LegalReapV2Adaptive-BASE:Q8_0
# Run inference directly in the terminal:
llama cli -hf ProprietaryLegal/MiniMax-2.7-LegalReapV2Adaptive-BASE:Q8_0
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf ProprietaryLegal/MiniMax-2.7-LegalReapV2Adaptive-BASE:Q8_0
# Run inference directly in the terminal:
llama cli -hf ProprietaryLegal/MiniMax-2.7-LegalReapV2Adaptive-BASE:Q8_0
Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf ProprietaryLegal/MiniMax-2.7-LegalReapV2Adaptive-BASE:Q8_0
# Run inference directly in the terminal:
./llama-cli -hf ProprietaryLegal/MiniMax-2.7-LegalReapV2Adaptive-BASE:Q8_0
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf ProprietaryLegal/MiniMax-2.7-LegalReapV2Adaptive-BASE:Q8_0
# Run inference directly in the terminal:
./build/bin/llama-cli -hf ProprietaryLegal/MiniMax-2.7-LegalReapV2Adaptive-BASE:Q8_0
Use Docker
docker model run hf.co/ProprietaryLegal/MiniMax-2.7-LegalReapV2Adaptive-BASE:Q8_0
Quick Links

MiniMax-2.7-LegalReapV2Adaptive-BASE

Published by PLI Labs, the open research arm of Proprietary Legal Intelligence. PLI builds AI systems around a legal organization's own work product, combining retrieval, staged workflows, validation, and attorney review. Visit proprietarylegal.ai to explore our work and discuss what your organization needs.

An adaptively expert-pruned, legal-domain-calibrated derivative of MiniMax-M2.7 — 35% of experts removed with per-layer precision, servable on stock llama.cpp, including pre-Ampere (Volta) hardware.

This is the BASE (pre-recovery) release of the LegalReap V2 line: the structural prune itself, published with full provenance before any post-training. Healed and optimized variants build on this artifact.

What makes this release interesting

  • Adaptive, not uniform. Most published MoE prunes cut every layer by the same ratio. This model's per-layer retained-expert counts (116–198 of the original 256) were chosen from measured expert saliency on real legal workloads — layers that concentrate importance keep more experts; redundant layers give up more. Overall: 10,317 of 15,872 experts retained (65.0%) across 62 MoE layers, top-8 routing preserved.
  • Calibrated on real professional work. Saliency observation ran over a curated, 16-bucket calibration corpus drawn from a practicing attorney's private legal workload — drafting, document analysis, financial tracing, RAG planning/judging, routing, summarization, and abstention roles across multiple context lengths. (The corpus itself is private and is not part of this release; no client material is embedded in, or recoverable from, a structural prune.)
  • A novel GGUF export path for adaptive MoE. Non-uniform expert counts don't fit GGUF's uniform stacked-expert format, so this release ships via a pad-to-uniform export: each layer is padded to 198 experts with never-selectable dummy experts (finite large-negative selection bias), and the true per-layer retained counts are recorded in the GGUF metadata. The result loads and serves on stock llama.cpp — no fork required. The conversion patch (against upstream convert_hf_to_gguf) is included in this repo for reproducibility.
  • Runs where big MoEs usually don't. The Q8_0 GGUF (189 GB, 809 tensors) serves comfortably on a 10× Tesla V100-32GB (sm_70) node with layer split — hardware a generation older than what most 200B-class MoEs assume — and is proportionally lighter everywhere else: ~22% smaller than the equivalent unpruned M2.7 quantization at every precision.

Files

File What it is
*.safetensors + index The pruned model, bf16, HF Transformers format (adaptive metadata in config.json)
gguf/MiniMax-2.7-LegalReapV2Adaptive-BASE.Q8_0.gguf Q8_0 quantization, stock-llama.cpp servable
llama-cpp-minimax-adaptive-gguf-export.patch Conversion patch (pad-to-uniform adaptive export)
artifact_integrity.json Machine-checked integrity manifest (metadata consistency, shard coverage, tokenizer equivalence, tensor counts)
LICENSE MiniMax non-commercial license (inherited from the base model)

config.json carries the full per-layer map in reap_adaptive_retained_experts_by_layer (62 entries, 116–198), with reap_adaptive_nonuniform_experts: true.

Method in brief

Expert saliency was observed layerwise (REAP-style weighted activation statistics) over the legal calibration corpus on V100 hardware, per-layer retention ratios were derived from the measured saliency distribution rather than a global constant, and the prune was executed with router renormalization (seed 42, target ratio 0.35). Integrity gates run at every step — metadata completeness, shard coverage, semantic tokenizer equivalence against the base model, and tensor-count verification of both exports (809/809).

Status and roadmap

This is a research preview and the deliberate starting point of a documented recovery pipeline: diagnostics battery → targeted recovery (router recalibration, router-KD, adapter healing) → verified, evaluated releases. Formal held-out evaluations accompany the healed variants rather than this structural BASE — that ordering is intentional, so every published number lands on a clean, reproducible footing.

Provenance

  • Base model: MiniMax-M2.7 (bf16), © 2026 MiniMax, used under its non-commercial license.
  • F16 GGUF sha256: 3994ce00d215e1aee63056e64e2e54ff07b3cb0a82fc71f5d82a417c79e5892c
  • Q8_0 GGUF sha256: 2d89f5dd56a5198276d5c5d947b59ca9d94ba586f856cf7884e2ab6e76b99da3
  • Built 2026-07-07 by Proprietary Legal Intelligence (PLI Labs).

License

Inherits the MiniMax non-commercial license of the base model (see LICENSE): non-commercial use, modification, and redistribution permitted with notice; commercial use requires prior written authorization from MiniMax.


About PLI Labs

“Your proprietary work product is your proprietary intelligence.” PLI Labs is the open research arm of Proprietary Legal Intelligence. We publish legal model prunes, serving recipes for owned hardware, and open-source tools so readers can inspect our methods and test our claims before hiring us.

Founded by a practicing trial lawyer, PLI builds AI systems around a legal organization's own work product: retrieval, staged workflows, validation, and attorney review. The approach grew from systems running on live matters in a litigation practice. Our consulting work supports deployment through approved frontier APIs, private cloud, or open-weight models on hardware you own. Explore the research or contact us about your organization's work.

Website · PLI Labs · Research · GitHub · Hugging Face · Contact

Proprietary Legal Intelligence LLC is a technology consultancy, not a law firm, and does not provide legal services or legal advice.

Downloads last month
199
Safetensors
Model size
150B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ProprietaryLegal/MiniMax-2.7-LegalReapV2Adaptive-BASE

Quantized
(110)
this model

Collection including ProprietaryLegal/MiniMax-2.7-LegalReapV2Adaptive-BASE