Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,127 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
tags:
|
| 5 |
+
- android
|
| 6 |
+
- on-device
|
| 7 |
+
- litert
|
| 8 |
+
- llm
|
| 9 |
+
- gemma
|
| 10 |
+
- qwen
|
| 11 |
+
- phi
|
| 12 |
+
- nanochat
|
| 13 |
+
license: other
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
# NanoChat β On-Device Model Mirror
|
| 17 |
+
|
| 18 |
+
This repository hosts the quantized **LiteRT** model files used by **[NanoChat](https://github.com/adiagarwalrock/NanoChat)** β a free, open-source Android app that runs large language models fully on-device, with no internet connection required after the initial download and no API keys needed.
|
| 19 |
+
|
| 20 |
+
All models are mirrored here from their original sources so that NanoChat users on the Play Store can download them without needing a Hugging Face account.
|
| 21 |
+
|
| 22 |
+
---
|
| 23 |
+
|
| 24 |
+
## π± About NanoChat
|
| 25 |
+
|
| 26 |
+
NanoChat brings powerful, private AI chat to your Android phone. Everything runs locally on your device β your conversations never leave your phone.
|
| 27 |
+
|
| 28 |
+
- π **Fully private** β no data ever sent to any server
|
| 29 |
+
- β‘ **Fast** β GPU-accelerated inference via Google's LiteRT runtime
|
| 30 |
+
- π¦ **No account or API key required** β models download directly in-app
|
| 31 |
+
- πΌοΈ **Multimodal** β select models support image and audio input
|
| 32 |
+
- π **Free and open source**
|
| 33 |
+
|
| 34 |
+
**β [View NanoChat on GitHub](https://github.com/adiagarwalrock/NanoChat)**
|
| 35 |
+
|
| 36 |
+
---
|
| 37 |
+
|
| 38 |
+
## ποΈ Repository Structure
|
| 39 |
+
|
| 40 |
+
Each model lives in its own folder:
|
| 41 |
+
|
| 42 |
+
```
|
| 43 |
+
nanochat-models/
|
| 44 |
+
βββ Gemma3-1B-IT/
|
| 45 |
+
β βββ gemma3-1b-it-int4.litertlm
|
| 46 |
+
βββ Gemma-3n-E2B-it/
|
| 47 |
+
β βββ gemma-3n-E2B-it-int4.litertlm
|
| 48 |
+
βββ Gemma-3n-E4B-it/
|
| 49 |
+
β βββ gemma-3n-E4B-it-int4.litertlm
|
| 50 |
+
βββ MobileActions-270M/
|
| 51 |
+
β βββ mobile_actions_q8_ekv1024.litertlm
|
| 52 |
+
βββ Phi-4-mini-instruct/
|
| 53 |
+
β βββ Phi-4-mini-instruct_multi-prefill-seq_q8_ekv4096.litertlm
|
| 54 |
+
βββ Qwen2.5-1.5B-Instruct/
|
| 55 |
+
β βββ Qwen2.5-1.5B-Instruct_multi-prefill-seq_q8_ekv4096.litertlm
|
| 56 |
+
βββ Qwen3.5-0.8B-Instruct/
|
| 57 |
+
β βββ model_multimodal.litertlm
|
| 58 |
+
βββ Qwen3.5-2B-Instruct/
|
| 59 |
+
β βββ model_multimodal.litertlm
|
| 60 |
+
βββ Qwen3.5-4B-Instruct/
|
| 61 |
+
β βββ model_multimodal.litertlm
|
| 62 |
+
βββ TinyGarden-270M/
|
| 63 |
+
βββ tiny_garden_q8_ekv1024.litertlm
|
| 64 |
+
```
|
| 65 |
+
|
| 66 |
+
---
|
| 67 |
+
|
| 68 |
+
## π€ Available Models
|
| 69 |
+
|
| 70 |
+
### π¬ Chat Models
|
| 71 |
+
|
| 72 |
+
| Model | Size | Min RAM | Vision | Audio |
|
| 73 |
+
|---|---|---|---|---|
|
| 74 |
+
| Gemma3-1B-IT | 558 MB | 6 GB | β | β |
|
| 75 |
+
| Qwen2.5-1.5B-Instruct | 1.49 GB | 6 GB | β | β |
|
| 76 |
+
| Qwen3.5-0.8B-Instruct | 1.16 GB | 4 GB | β
| β |
|
| 77 |
+
| Qwen3.5-2B-Instruct | 2.78 GB | 8 GB | β
| β |
|
| 78 |
+
| Gemma-3n-E2B-it | 3.40 GB | 8 GB | β
| β
|
|
| 79 |
+
| Phi-4-mini-instruct | 3.81 GB | 8 GB | β | β |
|
| 80 |
+
| Qwen3.5-4B-Instruct | 5.26 GB | 8 GB | β
| β |
|
| 81 |
+
| Gemma-3n-E4B-it *(experimental)* | 4.58 GB | 12 GB | β
| β
|
|
| 82 |
+
|
| 83 |
+
### π οΈ Specialised Models
|
| 84 |
+
|
| 85 |
+
| Model | Size | Purpose |
|
| 86 |
+
|---|---|---|
|
| 87 |
+
| TinyGarden-270M | 276 MB | Tiny Garden game |
|
| 88 |
+
| MobileActions-270M | 276 MB | On-device mobile actions |
|
| 89 |
+
|
| 90 |
+
---
|
| 91 |
+
|
| 92 |
+
## π₯ Original Sources
|
| 93 |
+
|
| 94 |
+
| Model | Original Repo |
|
| 95 |
+
|---|---|
|
| 96 |
+
| Gemma3-1B-IT | [litert-community/Gemma3-1B-IT](https://huggingface.co/litert-community/Gemma3-1B-IT) |
|
| 97 |
+
| Qwen2.5-1.5B-Instruct | [litert-community/Qwen2.5-1.5B-Instruct](https://huggingface.co/litert-community/Qwen2.5-1.5B-Instruct) |
|
| 98 |
+
| Qwen3.5-0.8B-Instruct | [litert-community/Qwen3.5-0.8B-LiteRT](https://huggingface.co/litert-community/Qwen3.5-0.8B-LiteRT) |
|
| 99 |
+
| Qwen3.5-2B-Instruct | [litert-community/Qwen3.5-2B-LiteRT](https://huggingface.co/litert-community/Qwen3.5-2B-LiteRT) |
|
| 100 |
+
| Qwen3.5-4B-Instruct | [litert-community/Qwen3.5-4B-LiteRT](https://huggingface.co/litert-community/Qwen3.5-4B-LiteRT) |
|
| 101 |
+
| Gemma-3n-E2B-it | [google/gemma-3n-E2B-it-litert-lm](https://huggingface.co/google/gemma-3n-E2B-it-litert-lm) |
|
| 102 |
+
| Gemma-3n-E4B-it | [google/gemma-3n-E4B-it-litert-lm](https://huggingface.co/google/gemma-3n-E4B-it-litert-lm) |
|
| 103 |
+
| Phi-4-mini-instruct | [litert-community/Phi-4-mini-instruct](https://huggingface.co/litert-community/Phi-4-mini-instruct) |
|
| 104 |
+
| TinyGarden-270M | [litert-community/functiongemma-270m-ft-tiny-garden](https://huggingface.co/litert-community/functiongemma-270m-ft-tiny-garden) |
|
| 105 |
+
| MobileActions-270M | [litert-community/functiongemma-270m-ft-mobile-actions](https://huggingface.co/litert-community/functiongemma-270m-ft-mobile-actions) |
|
| 106 |
+
|
| 107 |
+
---
|
| 108 |
+
|
| 109 |
+
## βοΈ Licenses
|
| 110 |
+
|
| 111 |
+
| Model Family | License |
|
| 112 |
+
|---|---|
|
| 113 |
+
| Gemma 3, Gemma 3n, TinyGarden, MobileActions | [Gemma Terms of Use](https://ai.google.dev/gemma/terms) |
|
| 114 |
+
| Qwen 2.5, Qwen 3.5 | [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0) |
|
| 115 |
+
| Phi-4-mini | [MIT](https://opensource.org/licenses/MIT) |
|
| 116 |
+
|
| 117 |
+
> By downloading Gemma-family models through NanoChat you agree to the [Gemma Terms of Use](https://ai.google.dev/gemma/terms).
|
| 118 |
+
|
| 119 |
+
---
|
| 120 |
+
|
| 121 |
+
## π Keeping This Mirror Updated
|
| 122 |
+
|
| 123 |
+
This mirror is synced from the NanoChat [`model_allowlist`](https://github.com/adiagarwalrock/NanoChat) whenever a new version ships. Only `enabled` models are mirrored. Disabled models are not uploaded but existing files are never deleted, ensuring backwards compatibility with older app versions.
|
| 124 |
+
|
| 125 |
+
---
|
| 126 |
+
|
| 127 |
+
*Built with β€οΈ for the NanoChat community.*
|