IMvision12 commited on
Commit
a4aa590
·
verified ·
1 Parent(s): 1b254e7

Migrate to zeromodels (rename kf_*.json -> zm_*.json, fix refs in config + README, ensure tag + badge)

Browse files
Files changed (2) hide show
  1. README.md +18 -18
  2. kf_config.json → zm_config.json +3 -3
README.md CHANGED
@@ -2,13 +2,13 @@
2
  pipeline_tag: text-generation
3
  license: gemma
4
  base_model: google/gemma-2-27b
5
- library_name: kerasformers
6
  extra_gated_heading: Access Gemma on Hugging Face
7
  language:
8
  - en
9
  tags:
10
  - keras
11
- - kerasformers
12
  - gemma2
13
  - gemma
14
  - gemma-2-27b
@@ -19,16 +19,16 @@ tags:
19
  - tf
20
  ---
21
 
22
- *See [our collection](https://huggingface.co/kerasformers) for all Gemma 2 sizes and variants.*
23
 
24
  # Run Gemma 2 with Keras 3: JAX, PyTorch, or TensorFlow
25
 
26
- [![GitHub](https://img.shields.io/badge/GitHub-KerasFormers-181717?logo=github)](https://github.com/IMvision12/KerasFormers) [![Docs](https://img.shields.io/badge/Docs-Gemma_2-1f6feb)](https://imvision12.github.io/KerasFormers/gemma2/) [![HuggingFace](https://img.shields.io/badge/HuggingFace-Gemma_2-ffd21e?logo=huggingface&logoColor=black)](https://huggingface.co/kerasformers)
27
 
28
- # kerasformers/gemma-2-27b
29
 
30
  Pure-**Keras 3** conversion of [`google/gemma-2-27b`](https://huggingface.co/google/gemma-2-27b) for
31
- [kerasformers](https://github.com/IMvision12/KerasFormers). One implementation runs unmodified on
32
  **TensorFlow / Torch / JAX**. This is a base (pretrained) checkpoint, served here as **text -> text** via `Gemma2TextGenerate`; weights are
33
  stored in **bfloat16**.
34
 
@@ -41,33 +41,33 @@ For model details, license, and usage terms, see Google's
41
  import os
42
  os.environ["KERAS_BACKEND"] = "torch" # or "jax" / "tensorflow"
43
 
44
- from kerasformers.models.gemma2 import Gemma2TextGenerate, Gemma2Tokenizer
45
 
46
- model = Gemma2TextGenerate.from_weights("kerasformers/gemma-2-27b")
47
- tokenizer = Gemma2Tokenizer.from_weights("kerasformers/gemma-2-27b")
48
 
49
  inputs = tokenizer([{"role": "user", "content": "Hello, who are you?"}])
50
  outputs = model.generate(**inputs, max_new_tokens=64)
51
  print(tokenizer.decode(outputs[0]))
52
  ```
53
 
54
- Load any Gemma 2 variant the same way with `from_weights("kerasformers/<variant>")`:
55
 
56
  | Variant | Hub |
57
  | --- | --- |
58
- | `gemma-2-27b` | [kerasformers/gemma-2-27b](https://huggingface.co/kerasformers/gemma-2-27b) |
59
- | `gemma-2-27b-it` | [kerasformers/gemma-2-27b-it](https://huggingface.co/kerasformers/gemma-2-27b-it) |
60
- | `gemma-2-2b` | [kerasformers/gemma-2-2b](https://huggingface.co/kerasformers/gemma-2-2b) |
61
- | `gemma-2-2b-it` | [kerasformers/gemma-2-2b-it](https://huggingface.co/kerasformers/gemma-2-2b-it) |
62
- | `gemma-2-9b` | [kerasformers/gemma-2-9b](https://huggingface.co/kerasformers/gemma-2-9b) |
63
- | `gemma-2-9b-it` | [kerasformers/gemma-2-9b-it](https://huggingface.co/kerasformers/gemma-2-9b-it) |
64
 
65
  ## Tips
66
 
67
- - Set `KERAS_BACKEND` **before** importing Keras / kerasformers.
68
  - Loads in **bfloat16** by default. Pass `load_dtype="float32"` for full precision,
69
  or `quantization="int8"` to shrink further.
70
- - See the [Gemma 2 docs](https://imvision12.github.io/KerasFormers/gemma2/).
71
  - Community / upstream weights still work via the `hf:` prefix:
72
  `Gemma2TextGenerate.from_weights("hf:google/gemma-2-27b")`.
73
 
 
2
  pipeline_tag: text-generation
3
  license: gemma
4
  base_model: google/gemma-2-27b
5
+ library_name: zeromodels
6
  extra_gated_heading: Access Gemma on Hugging Face
7
  language:
8
  - en
9
  tags:
10
  - keras
11
+ - zeromodels
12
  - gemma2
13
  - gemma
14
  - gemma-2-27b
 
19
  - tf
20
  ---
21
 
22
+ *See [our collection](https://huggingface.co/zeromodels) for all Gemma 2 sizes and variants.*
23
 
24
  # Run Gemma 2 with Keras 3: JAX, PyTorch, or TensorFlow
25
 
26
+ [![GitHub](https://img.shields.io/badge/GitHub-ZeroModels-181717?logo=github)](https://github.com/IMvision12/ZeroModels) [![Docs](https://img.shields.io/badge/Docs-Gemma_2-1f6feb)](https://imvision12.github.io/ZeroModels/gemma2/) [![HuggingFace](https://img.shields.io/badge/HuggingFace-Gemma_2-ffd21e?logo=huggingface&logoColor=black)](https://huggingface.co/zeromodels)
27
 
28
+ # zeromodels/gemma-2-27b
29
 
30
  Pure-**Keras 3** conversion of [`google/gemma-2-27b`](https://huggingface.co/google/gemma-2-27b) for
31
+ [zeromodels](https://github.com/IMvision12/ZeroModels). One implementation runs unmodified on
32
  **TensorFlow / Torch / JAX**. This is a base (pretrained) checkpoint, served here as **text -> text** via `Gemma2TextGenerate`; weights are
33
  stored in **bfloat16**.
34
 
 
41
  import os
42
  os.environ["KERAS_BACKEND"] = "torch" # or "jax" / "tensorflow"
43
 
44
+ from zeromodels.models.gemma2 import Gemma2TextGenerate, Gemma2Tokenizer
45
 
46
+ model = Gemma2TextGenerate.from_weights("zeromodels/gemma-2-27b")
47
+ tokenizer = Gemma2Tokenizer.from_weights("zeromodels/gemma-2-27b")
48
 
49
  inputs = tokenizer([{"role": "user", "content": "Hello, who are you?"}])
50
  outputs = model.generate(**inputs, max_new_tokens=64)
51
  print(tokenizer.decode(outputs[0]))
52
  ```
53
 
54
+ Load any Gemma 2 variant the same way with `from_weights("zeromodels/<variant>")`:
55
 
56
  | Variant | Hub |
57
  | --- | --- |
58
+ | `gemma-2-27b` | [zeromodels/gemma-2-27b](https://huggingface.co/zeromodels/gemma-2-27b) |
59
+ | `gemma-2-27b-it` | [zeromodels/gemma-2-27b-it](https://huggingface.co/zeromodels/gemma-2-27b-it) |
60
+ | `gemma-2-2b` | [zeromodels/gemma-2-2b](https://huggingface.co/zeromodels/gemma-2-2b) |
61
+ | `gemma-2-2b-it` | [zeromodels/gemma-2-2b-it](https://huggingface.co/zeromodels/gemma-2-2b-it) |
62
+ | `gemma-2-9b` | [zeromodels/gemma-2-9b](https://huggingface.co/zeromodels/gemma-2-9b) |
63
+ | `gemma-2-9b-it` | [zeromodels/gemma-2-9b-it](https://huggingface.co/zeromodels/gemma-2-9b-it) |
64
 
65
  ## Tips
66
 
67
+ - Set `KERAS_BACKEND` **before** importing Keras / zeromodels.
68
  - Loads in **bfloat16** by default. Pass `load_dtype="float32"` for full precision,
69
  or `quantization="int8"` to shrink further.
70
+ - See the [Gemma 2 docs](https://imvision12.github.io/ZeroModels/gemma2/).
71
  - Community / upstream weights still work via the `hf:` prefix:
72
  `Gemma2TextGenerate.from_weights("hf:google/gemma-2-27b")`.
73
 
kf_config.json → zm_config.json RENAMED
@@ -1,7 +1,7 @@
1
  {
2
- "library_name": "kerasformers",
3
- "kerasformers_version": "1.2.1",
4
- "model_module": "kerasformers.models.gemma2",
5
  "model_class": "Gemma2TextGenerate",
6
  "variant": "gemma-2-27b",
7
  "weights": "model.weights.json",
 
1
  {
2
+ "library_name": "zeromodels",
3
+ "zeromodels_version": "1.2.1",
4
+ "model_module": "zeromodels.models.gemma2",
5
  "model_class": "Gemma2TextGenerate",
6
  "variant": "gemma-2-27b",
7
  "weights": "model.weights.json",