wokenlex commited on
Commit
46c05fc
·
verified ·
1 Parent(s): 67816cb

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +55 -0
README.md ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: apache-2.0-and-gemma
4
+ license_link: LICENSE.md
5
+ base_model:
6
+ - google/gemma-4-E4B-it
7
+ - google/embeddinggemma-300m
8
+ tags:
9
+ - coreml
10
+ - apple-neural-engine
11
+ - on-device
12
+ ---
13
+
14
+ # BubbleCrawler models
15
+
16
+ The two Core ML models that [BubbleCrawler](https://github.com/wokenlex/bubblecrawler)
17
+ downloads on first launch. The app runs them on the Apple Neural Engine.
18
+
19
+ ## Gemma4E4B
20
+
21
+ gemma-4-E4B-it for the chunked engine of
22
+ [john-rocky/CoreML-LLM](https://github.com/john-rocky/CoreML-LLM): four decode
23
+ chunks plus batched prefill (N = 2048), context 4096.
24
+
25
+ This conversion differs from `mlboydaisuke/gemma-4-E4B-coreml` in three ways:
26
+
27
+ - **RoPE tables fixed.** `cos_full.npy` / `sin_full.npy` implement Gemma 4's
28
+ proportional RoPE for full attention: only the first 64 of the 256
29
+ frequencies rotate. Upstream rotates all of them, so the model loses track of
30
+ anything more than ~512 tokens back.
31
+ - **Band mask for prefill.** Prefill applies the 512-token band mask to the
32
+ sliding-window layers.
33
+ - **Multifunction chunks.** Each `chunkN.mlmodelc` holds two functions,
34
+ `decode_q1` (the default) and `prefill`, which share one copy of the weights.
35
+ The `verify_qK` functions are not included.
36
+
37
+ The tokenizer adds no BOS token, so prepend `<bos>` yourself.
38
+
39
+ ## EmbeddingGemma
40
+
41
+ EmbeddingGemma-300M from
42
+ [erjigit17/embeddinggemma-300m-ane-coreml](https://huggingface.co/erjigit17/embeddinggemma-300m-ane-coreml),
43
+ compiled to `model.mlmodelc`.
44
+
45
+ - Inputs: `input_ids` and `attention_mask`, each int32 `[1, 128]`.
46
+ - Output: `embedding`, `[1, 768]`.
47
+
48
+ ## Licenses
49
+
50
+ - **Gemma4E4B:** Apache 2.0, the license of `google/gemma-4-E4B-it`.
51
+ - **EmbeddingGemma:** Gemma is provided under and subject to the Gemma Terms of
52
+ Use found at [ai.google.dev/gemma/terms](https://ai.google.dev/gemma/terms).
53
+ Use is also subject to the
54
+ [Gemma Prohibited Use Policy](https://ai.google.dev/gemma/prohibited_use_policy).
55
+ See `EmbeddingGemma/NOTICE`.