Granite 4.1 3B Abliterated β LiteRT (Android Edge Gallery)
Abliterated IBM Granite 4.1 3B in .litertlm format for on-device inference via Google AI Edge Gallery.
Strong enterprise reasoning and code capability β runs locally on Android, offline, no API, no filters.
Files
| File | Size | Base Model | Params |
|---|---|---|---|
model.litertlm |
~2.4 GB | DuoNeural/Granite-4.1-3B-Abliterated | ~3B |
INT4 quantized (dynamic weight INT4, FP32 activations) via litert-torch 0.9.0.
How to Use on Android
Requirements
- Android 12 or newer
- Google AI Edge Gallery app installed
- Sufficient storage space
Install Steps
- Open this page on your Android device in Chrome
- Tap the
.litertlmfile β tap download (β¬) - Open AI Edge Gallery β tap + β select the file from Downloads
- Choose backend:
- GPU (Vulkan/OpenCL) β fastest on modern Androids
- CPU (XNNPACK) β most compatible
- NPU β best on Snapdragon/MediaTek if available
- Chat β fully offline, nothing leaves the device
Performance (estimated)
| Device | Backend | Tokens/sec |
|---|---|---|
| Flagship (SD 8 Gen 3+) | GPU/NPU | 15β40 tok/s |
| Mid-range | GPU | 5β15 tok/s |
| Any Android 12+ | CPU | 1β5 tok/s |
Conversion: litert-torch 0.9.0, dynamic_wi4_afp32 recipe, cache_length=1024, --use_jinja_template False.
Source Model
DuoNeural/Granite-4.1-3B-Abliterated β BF16 abliterated IBM Granite 4.1 3B.
License
Apache 2.0.
DuoNeural
DuoNeural is an open AI research lab β human + AI in collaboration.
| Platform | Link |
|---|---|
| HuggingFace | huggingface.co/DuoNeural |
| Website | duoneural.com |
| GitHub | github.com/DuoNeural |
| X / Twitter | @DuoNeural |
| duoneural@proton.me | |
| Newsletter | duoneural.beehiiv.com |
| Support | buymeacoffee.com/duoneural |
DuoNeural Research Publications
Open access, CC BY 4.0. Authored by Archon, Jesse Caldwell, Aura β DuoNeural.
Research Team
- Jesse β Vision, hardware, direction
- Archon β Lab Director, post-training, abliteration, experiments
- Aura β Research AI, literature synthesis, peer review, novel proposals
Subscribe to the lab newsletter at duoneural.beehiiv.com for model drops before they go anywhere else.
- Downloads last month
- -
Model tree for DuoNeural/Granite-4.1-3B-LiteRT
Base model
DuoNeural/Granite-4.1-3B-Abliterated