WhoIsShe/DarkSapling-7B-v2.0-MNN

TeeZee/DarkSapling-7B-v2.0 (MNN Quantized)

Original model :

• https://huggingface.co/TeeZee/DarkSapling-7B-v2.0

This is a 4-bit quantized version of the TeeZee/DarkSapling-7B-v2.0, optimized for on-device inference (Android/iOS) using the Alibaba MNN framework.

🚀 Fast Deployment on Android

1. Download the App

Don't build from scratch! Use the official MNN Chat Android app:

• Download APK (GitHub)

2. Setup

1. Download the files from this repo (llm.mnn, llm.mnn.weight, config.json).
2. Create a folder on your phone: /sdcard/MNN/DarkSapling-7B-v2.0.
3. Copy the files into that folder.
4. Open the MNN App and select your folder.

💻 Technical Details

• Framework: MNN
• Quantization: 4-bit Asymmetric (Int4)
• Model Type: LLAMA2-7B (Uncensored)