How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf OrbitMC/Mew1-2.6B
# Run inference directly in the terminal:
llama cli -hf OrbitMC/Mew1-2.6B
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf OrbitMC/Mew1-2.6B
# Run inference directly in the terminal:
llama cli -hf OrbitMC/Mew1-2.6B
Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf OrbitMC/Mew1-2.6B
# Run inference directly in the terminal:
./llama-cli -hf OrbitMC/Mew1-2.6B
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf OrbitMC/Mew1-2.6B
# Run inference directly in the terminal:
./build/bin/llama-cli -hf OrbitMC/Mew1-2.6B
Use Docker
docker model run hf.co/OrbitMC/Mew1-2.6B
Quick Links

🐱 Mew1-2.6B

Mew1-2.6B is a high-performance, next-generation language model developed by Unmid. Engineered for elite intelligence and uncensored freedom, Mew provides unparalleled reasoning capabilities and creative depth at a compact 2.6B parameter scale.

Designed to push the limits of small-scale language modeling, Mew delivers instantaneous responses while maintaining a sophisticated grasp of complex instructions and nuanced roleplay. It excels in environments where low latency and high creative output are required.

🌟 Key Features

  • Uncensored by Design: Optimized for unrestricted creative expression and objective reasoning.
  • Linear RNN Efficiency: Built on a specialized architecture that offers linear scaling for long contexts.
  • Elite Reasoning: Outperforms many models twice its size in logic and instruction following.

📦 GGUF Downloads

File Method Estimated Size Download Best For
Mew1-2.6B-q2-k.gguf Q2_K 0.85 GB download Ultra-low RAM
Mew1-2.6B-q4-k-m.gguf Q4_K_M 1.56 GB download Balanced (Recommended)
Mew1-2.6B-q6-k.gguf Q6_K 2.15 GB download High Precision
Mew1-2.6B-q8-0.gguf Q8_0 2.76 GB download Maximum Quality

🛠️ Technical Specifications

  • Parameters: 2.6 Billion
  • Architecture: Fine-tuned Liquid Foundation Model (LFM) 2.5
  • Context Window: 32,768 Tokens
  • Training Focus: Advanced reasoning, creative writing, and technical instruction following.

🎯 Use Cases

  • Creative Writing: Drafting stories, scripts, and roleplay scenarios with deep character consistency.
  • Technical Assistance: Explaining complex concepts and generating code snippets.
  • Local Deployment: Ideal for mobile devices, low-power laptops, and private server environments.

⚙️ Hardware Recommendations

Quantization Minimum RAM Recommended Hardware
Q2_K 2 GB Most Mobile Phones
Q4_K_M 4 GB Standard Laptop / iPhone 13+
Q8_0 6 GB Dedicated GPU / 8GB+ Desktop RAM

🚀 Usage Instructions

Compatible with llama.cpp, LM Studio, and KoboldCPP.

Recommended Settings:

  • Temperature: 0.7 - 0.85 (for creativity)
  • Repeat Penalty: 1.1
  • Top-P: 0.9

Developed with ❤️ by Unmid

Downloads last month
-
Safetensors
Model size
3B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for OrbitMC/Mew1-2.6B

Quantized
(57)
this model