adiagarwal commited on
Commit
b936675
Β·
verified Β·
1 Parent(s): e01beac

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +127 -0
README.md ADDED
@@ -0,0 +1,127 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ tags:
5
+ - android
6
+ - on-device
7
+ - litert
8
+ - llm
9
+ - gemma
10
+ - qwen
11
+ - phi
12
+ - nanochat
13
+ license: other
14
+ ---
15
+
16
+ # NanoChat β€” On-Device Model Mirror
17
+
18
+ This repository hosts the quantized **LiteRT** model files used by **[NanoChat](https://github.com/adiagarwalrock/NanoChat)** β€” a free, open-source Android app that runs large language models fully on-device, with no internet connection required after the initial download and no API keys needed.
19
+
20
+ All models are mirrored here from their original sources so that NanoChat users on the Play Store can download them without needing a Hugging Face account.
21
+
22
+ ---
23
+
24
+ ## πŸ“± About NanoChat
25
+
26
+ NanoChat brings powerful, private AI chat to your Android phone. Everything runs locally on your device β€” your conversations never leave your phone.
27
+
28
+ - πŸ”’ **Fully private** β€” no data ever sent to any server
29
+ - ⚑ **Fast** β€” GPU-accelerated inference via Google's LiteRT runtime
30
+ - πŸ“¦ **No account or API key required** β€” models download directly in-app
31
+ - πŸ–ΌοΈ **Multimodal** β€” select models support image and audio input
32
+ - πŸ†“ **Free and open source**
33
+
34
+ **β†’ [View NanoChat on GitHub](https://github.com/adiagarwalrock/NanoChat)**
35
+
36
+ ---
37
+
38
+ ## πŸ—‚οΈ Repository Structure
39
+
40
+ Each model lives in its own folder:
41
+
42
+ ```
43
+ nanochat-models/
44
+ β”œβ”€β”€ Gemma3-1B-IT/
45
+ β”‚ └── gemma3-1b-it-int4.litertlm
46
+ β”œβ”€β”€ Gemma-3n-E2B-it/
47
+ β”‚ └── gemma-3n-E2B-it-int4.litertlm
48
+ β”œβ”€β”€ Gemma-3n-E4B-it/
49
+ β”‚ └── gemma-3n-E4B-it-int4.litertlm
50
+ β”œβ”€β”€ MobileActions-270M/
51
+ β”‚ └── mobile_actions_q8_ekv1024.litertlm
52
+ β”œβ”€β”€ Phi-4-mini-instruct/
53
+ β”‚ └── Phi-4-mini-instruct_multi-prefill-seq_q8_ekv4096.litertlm
54
+ β”œβ”€β”€ Qwen2.5-1.5B-Instruct/
55
+ β”‚ └── Qwen2.5-1.5B-Instruct_multi-prefill-seq_q8_ekv4096.litertlm
56
+ β”œβ”€β”€ Qwen3.5-0.8B-Instruct/
57
+ β”‚ └── model_multimodal.litertlm
58
+ β”œβ”€β”€ Qwen3.5-2B-Instruct/
59
+ β”‚ └── model_multimodal.litertlm
60
+ β”œβ”€β”€ Qwen3.5-4B-Instruct/
61
+ β”‚ └── model_multimodal.litertlm
62
+ └── TinyGarden-270M/
63
+ └── tiny_garden_q8_ekv1024.litertlm
64
+ ```
65
+
66
+ ---
67
+
68
+ ## πŸ€– Available Models
69
+
70
+ ### πŸ’¬ Chat Models
71
+
72
+ | Model | Size | Min RAM | Vision | Audio |
73
+ |---|---|---|---|---|
74
+ | Gemma3-1B-IT | 558 MB | 6 GB | ❌ | ❌ |
75
+ | Qwen2.5-1.5B-Instruct | 1.49 GB | 6 GB | ❌ | ❌ |
76
+ | Qwen3.5-0.8B-Instruct | 1.16 GB | 4 GB | βœ… | ❌ |
77
+ | Qwen3.5-2B-Instruct | 2.78 GB | 8 GB | βœ… | ❌ |
78
+ | Gemma-3n-E2B-it | 3.40 GB | 8 GB | βœ… | βœ… |
79
+ | Phi-4-mini-instruct | 3.81 GB | 8 GB | ❌ | ❌ |
80
+ | Qwen3.5-4B-Instruct | 5.26 GB | 8 GB | βœ… | ❌ |
81
+ | Gemma-3n-E4B-it *(experimental)* | 4.58 GB | 12 GB | βœ… | βœ… |
82
+
83
+ ### πŸ› οΈ Specialised Models
84
+
85
+ | Model | Size | Purpose |
86
+ |---|---|---|
87
+ | TinyGarden-270M | 276 MB | Tiny Garden game |
88
+ | MobileActions-270M | 276 MB | On-device mobile actions |
89
+
90
+ ---
91
+
92
+ ## πŸ“₯ Original Sources
93
+
94
+ | Model | Original Repo |
95
+ |---|---|
96
+ | Gemma3-1B-IT | [litert-community/Gemma3-1B-IT](https://huggingface.co/litert-community/Gemma3-1B-IT) |
97
+ | Qwen2.5-1.5B-Instruct | [litert-community/Qwen2.5-1.5B-Instruct](https://huggingface.co/litert-community/Qwen2.5-1.5B-Instruct) |
98
+ | Qwen3.5-0.8B-Instruct | [litert-community/Qwen3.5-0.8B-LiteRT](https://huggingface.co/litert-community/Qwen3.5-0.8B-LiteRT) |
99
+ | Qwen3.5-2B-Instruct | [litert-community/Qwen3.5-2B-LiteRT](https://huggingface.co/litert-community/Qwen3.5-2B-LiteRT) |
100
+ | Qwen3.5-4B-Instruct | [litert-community/Qwen3.5-4B-LiteRT](https://huggingface.co/litert-community/Qwen3.5-4B-LiteRT) |
101
+ | Gemma-3n-E2B-it | [google/gemma-3n-E2B-it-litert-lm](https://huggingface.co/google/gemma-3n-E2B-it-litert-lm) |
102
+ | Gemma-3n-E4B-it | [google/gemma-3n-E4B-it-litert-lm](https://huggingface.co/google/gemma-3n-E4B-it-litert-lm) |
103
+ | Phi-4-mini-instruct | [litert-community/Phi-4-mini-instruct](https://huggingface.co/litert-community/Phi-4-mini-instruct) |
104
+ | TinyGarden-270M | [litert-community/functiongemma-270m-ft-tiny-garden](https://huggingface.co/litert-community/functiongemma-270m-ft-tiny-garden) |
105
+ | MobileActions-270M | [litert-community/functiongemma-270m-ft-mobile-actions](https://huggingface.co/litert-community/functiongemma-270m-ft-mobile-actions) |
106
+
107
+ ---
108
+
109
+ ## βš–οΈ Licenses
110
+
111
+ | Model Family | License |
112
+ |---|---|
113
+ | Gemma 3, Gemma 3n, TinyGarden, MobileActions | [Gemma Terms of Use](https://ai.google.dev/gemma/terms) |
114
+ | Qwen 2.5, Qwen 3.5 | [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0) |
115
+ | Phi-4-mini | [MIT](https://opensource.org/licenses/MIT) |
116
+
117
+ > By downloading Gemma-family models through NanoChat you agree to the [Gemma Terms of Use](https://ai.google.dev/gemma/terms).
118
+
119
+ ---
120
+
121
+ ## πŸ”„ Keeping This Mirror Updated
122
+
123
+ This mirror is synced from the NanoChat [`model_allowlist`](https://github.com/adiagarwalrock/NanoChat) whenever a new version ships. Only `enabled` models are mirrored. Disabled models are not uploaded but existing files are never deleted, ensuring backwards compatibility with older app versions.
124
+
125
+ ---
126
+
127
+ *Built with ❀️ for the NanoChat community.*