Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,55 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: apache-2.0-and-gemma
|
| 4 |
+
license_link: LICENSE.md
|
| 5 |
+
base_model:
|
| 6 |
+
- google/gemma-4-E4B-it
|
| 7 |
+
- google/embeddinggemma-300m
|
| 8 |
+
tags:
|
| 9 |
+
- coreml
|
| 10 |
+
- apple-neural-engine
|
| 11 |
+
- on-device
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# BubbleCrawler models
|
| 15 |
+
|
| 16 |
+
The two Core ML models that [BubbleCrawler](https://github.com/wokenlex/bubblecrawler)
|
| 17 |
+
downloads on first launch. The app runs them on the Apple Neural Engine.
|
| 18 |
+
|
| 19 |
+
## Gemma4E4B
|
| 20 |
+
|
| 21 |
+
gemma-4-E4B-it for the chunked engine of
|
| 22 |
+
[john-rocky/CoreML-LLM](https://github.com/john-rocky/CoreML-LLM): four decode
|
| 23 |
+
chunks plus batched prefill (N = 2048), context 4096.
|
| 24 |
+
|
| 25 |
+
This conversion differs from `mlboydaisuke/gemma-4-E4B-coreml` in three ways:
|
| 26 |
+
|
| 27 |
+
- **RoPE tables fixed.** `cos_full.npy` / `sin_full.npy` implement Gemma 4's
|
| 28 |
+
proportional RoPE for full attention: only the first 64 of the 256
|
| 29 |
+
frequencies rotate. Upstream rotates all of them, so the model loses track of
|
| 30 |
+
anything more than ~512 tokens back.
|
| 31 |
+
- **Band mask for prefill.** Prefill applies the 512-token band mask to the
|
| 32 |
+
sliding-window layers.
|
| 33 |
+
- **Multifunction chunks.** Each `chunkN.mlmodelc` holds two functions,
|
| 34 |
+
`decode_q1` (the default) and `prefill`, which share one copy of the weights.
|
| 35 |
+
The `verify_qK` functions are not included.
|
| 36 |
+
|
| 37 |
+
The tokenizer adds no BOS token, so prepend `<bos>` yourself.
|
| 38 |
+
|
| 39 |
+
## EmbeddingGemma
|
| 40 |
+
|
| 41 |
+
EmbeddingGemma-300M from
|
| 42 |
+
[erjigit17/embeddinggemma-300m-ane-coreml](https://huggingface.co/erjigit17/embeddinggemma-300m-ane-coreml),
|
| 43 |
+
compiled to `model.mlmodelc`.
|
| 44 |
+
|
| 45 |
+
- Inputs: `input_ids` and `attention_mask`, each int32 `[1, 128]`.
|
| 46 |
+
- Output: `embedding`, `[1, 768]`.
|
| 47 |
+
|
| 48 |
+
## Licenses
|
| 49 |
+
|
| 50 |
+
- **Gemma4E4B:** Apache 2.0, the license of `google/gemma-4-E4B-it`.
|
| 51 |
+
- **EmbeddingGemma:** Gemma is provided under and subject to the Gemma Terms of
|
| 52 |
+
Use found at [ai.google.dev/gemma/terms](https://ai.google.dev/gemma/terms).
|
| 53 |
+
Use is also subject to the
|
| 54 |
+
[Gemma Prohibited Use Policy](https://ai.google.dev/gemma/prohibited_use_policy).
|
| 55 |
+
See `EmbeddingGemma/NOTICE`.
|