Upload Gemma 3 1B PT Orbax/TensorStore checkpoint
Browse files- .gitattributes +2 -0
- LICENSE +55 -0
- NOTICE +1 -0
- _CHECKPOINT_METADATA +1 -0
- _METADATA +1 -0
- commit_success.txt +1 -0
- d/41c8f074b3399d92d243264bcd7fe38e +0 -0
- manifest.ocdbt +0 -0
- ocdbt.process_0/d/763b51d009af4ff959c695b7b95cebac +3 -0
- ocdbt.process_0/d/86298f6c080bc76319a8c1478c4a726f +3 -0
- ocdbt.process_0/d/e52101dba7256673c810a653c9407973 +0 -0
- ocdbt.process_0/d/e61deca8241ff271af8220bc0cbeb47b +0 -0
- ocdbt.process_0/manifest.ocdbt +0 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
ocdbt.process_0/d/763b51d009af4ff959c695b7b95cebac filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
ocdbt.process_0/d/86298f6c080bc76319a8c1478c4a726f filter=lfs diff=lfs merge=lfs -text
|
LICENSE
ADDED
|
@@ -0,0 +1,55 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Gemma Terms of Use
|
| 2 |
+
|
| 3 |
+
Last modified: April 1, 2024
|
| 4 |
+
|
| 5 |
+
Thank you for using Gemma! These terms of use ("Terms") are entered into by and between Google LLC ("Google") and you and govern your use of Gemma. This is an agreement between you and Google. If you are accepting these Terms and using Gemma on behalf of another person or entity, you represent and warrant that you have full authority to bind that person or entity to these Terms.
|
| 6 |
+
|
| 7 |
+
1. THE AGREEMENT
|
| 8 |
+
|
| 9 |
+
1.1 These Terms apply only to Gemma and any use or access you obtain to Gemma. For the purpose of these Terms, "Gemma" means the Gemma model and software and tools made available by Google, and any software, documentation, or other materials provided by Google relating to Gemma. Gemma may be: (a) a standalone product, or (b) a component of other software products. Gemma is not a Google Service or a Google Product as described in Google’s Terms of Service (https://policies.google.com/terms). These Terms do not apply to any Third Party Products (defined in Section 2.3) or any other Google products or services.
|
| 10 |
+
|
| 11 |
+
1.2 “You” means you as an individual or entity, or your authorized representative. If you or your organization have a separate, written agreement with Google governing your use of Gemma, that agreement will supersede these Terms.
|
| 12 |
+
|
| 13 |
+
2. LICENSE AND USE
|
| 14 |
+
|
| 15 |
+
2.1 Subject to your compliance with these Terms, Google grants you a perpetual, non-exclusive, worldwide, non-transferable, non-sublicensable license to use, reproduce, distribute, perform, and display Gemma, to prepare Derivatives of Gemma, and otherwise use Gemma in your Derivative Models.
|
| 16 |
+
|
| 17 |
+
2.2 You may publicly distribute or make available to third parties, without restriction or charge, Gemma, Derivative Models, and Derivative Works (collectively, the “Artifacts”), provided you: (a) comply with these Terms; (b) provide a copy of these Terms; (c) provide attribution to Google as the source of Gemma in a manner that is reasonable and customary within the industry or context; (d) include a prominent notice with any Derivative Works stating that you have modified Gemma; and (e) include the following notice: "Gemma is provided under and subject to the Gemma Terms of Use found at ai.google.dev/gemma/terms".
|
| 18 |
+
|
| 19 |
+
2.3 You may use Third Party Products with Gemma. "Third Party Products" means third-party software, data, or other resources. Third Party Products may be subject to their own terms and Google is not responsible for Third Party Products.
|
| 20 |
+
|
| 21 |
+
3. RESTRICTIONS AND PROHIBITED USE POLICY
|
| 22 |
+
|
| 23 |
+
3.1 You will comply with the Gemma Prohibited Use Policy (provided at ai.google.dev/gemma/terms). Google may update the Gemma Prohibited Use Policy from time to time by publishing a new version at ai.google.dev/gemma/terms.
|
| 24 |
+
|
| 25 |
+
3.2 You will not use Gemma or Derivatives, or allow or facilitate its use, for any of the following:
|
| 26 |
+
|
| 27 |
+
(a) High Risk Activities: any use that could lead to death, personal injury, or environmental damage, such as in: (i) emergency services; (ii) military, law enforcement, or surveillance; (iii) management or operation of critical infrastructure; or (iv) safety applications.
|
| 28 |
+
|
| 29 |
+
(b) Development or Use of Weapons. Prohibited uses include, but are not limited to, research, development, production, testing, maintenance or use of: (i) weapons; (ii) technologies that cause physical injury or death; or (iii) agents intended to cause harm to humans, animals, or property.
|
| 30 |
+
|
| 31 |
+
(c) Malicious, Abusive, or Unlawful Activities. Prohibited uses include, but are not limited to, use of Gemma or Derivatives to: (i) develop malware, including spyware; (ii) engage in phishing, fraud, or other deceptive activities; (iii) engage in cyber abuse, including denial of service or hacking; (iv) exploit vulnerabilities; (v) generate or disseminate spam; or (vi) facilitate or encourage violations of law.
|
| 32 |
+
|
| 33 |
+
(d) Automated Decision-Making. Prohibited uses include, but are not limited to, use of Gemma or Derivatives to: (i) make decisions on behalf of decision makers within government; (ii) make decisions that determine an individual’s eligibility or selection within education, employment, housing, insurance, or credit; or (iii) make decisions, recommendations, or rankings that determine a person’s eligibility or access within healthcare or legal services.
|
| 34 |
+
|
| 35 |
+
(e) Harmful or Scams. Prohibited uses include, but are not limited to, use of Gemma or Derivatives to: (i) facilitate, encourage, or further scams; (ii) generate or disseminate content that incites violence or hatred; (iii) assist in exploitation or abuse of minors; or (iv) promote or facilitate discrimination.
|
| 36 |
+
|
| 37 |
+
4. TERM AND TERMINATION
|
| 38 |
+
|
| 39 |
+
4.1 These Terms are effective upon your first use, access, or download of Gemma and will continue until terminated.
|
| 40 |
+
|
| 41 |
+
4.2 Google may suspend or terminate your use of Gemma at any time if it believes you have breached these Terms or to comply with applicable law. If Google suspends or terminates your use, you must stop using Gemma.
|
| 42 |
+
|
| 43 |
+
4.3 Upon termination, you must cease all use of Gemma and delete Gemma and all Derivatives.
|
| 44 |
+
|
| 45 |
+
5. DISCLAIMERS
|
| 46 |
+
|
| 47 |
+
5.1 GEMMA IS PROVIDED "AS IS" WITHOUT WARRANTIES OF ANY KIND. GOOGLE DISCLAIMS ALL WARRANTIES AND CONDITIONS, EXPRESS OR IMPLIED, INCLUDING ANY WARRANTIES OR CONDITIONS OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NON-INFRINGEMENT.
|
| 48 |
+
|
| 49 |
+
5.2 YOU ARE RESPONSIBLE FOR YOUR USE OF GEMMA AND DERIVATIVES.
|
| 50 |
+
|
| 51 |
+
5.3 IN NO EVENT WILL GOOGLE OR ITS AFFILIATES BE LIABLE FOR ANY INDIRECT, INCIDENTAL, SPECIAL, CONSEQUENTIAL, OR EXEMPLARY DAMAGES OR LOST PROFITS ARISING FROM OR IN CONNECTION WITH THESE TERMS OR USE OF GEMMA.
|
| 52 |
+
|
| 53 |
+
If you have any questions regarding these Terms, you may contact Google at gemma@google.com.
|
| 54 |
+
|
| 55 |
+
Please read these Terms carefully and keep a copy for your reference.
|
NOTICE
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Gemma is provided under and subject to the Gemma Terms of Use found at ai.google.dev/gemma/terms
|
_CHECKPOINT_METADATA
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"item_handlers": "orbax.checkpoint._src.handlers.standard_checkpoint_handler.StandardCheckpointHandler", "metrics": {}, "performance_metrics": {}, "init_timestamp_nsecs": 1770760337493898281, "commit_timestamp_nsecs": 1770760349542662922, "custom_metadata": {}}
|
_METADATA
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"tree_metadata": {"('model.embed_tokens.weight',)": {"key_metadata": [{"key": "model.embed_tokens.weight", "key_type": 2}], "value_metadata": {"value_type": "np.ndarray", "skip_deserialize": false}}, "('model.layers.input_layernorm.weight',)": {"key_metadata": [{"key": "model.layers.input_layernorm.weight", "key_type": 2}], "value_metadata": {"value_type": "np.ndarray", "skip_deserialize": false}}, "('model.layers.mlp.down_proj.weight',)": {"key_metadata": [{"key": "model.layers.mlp.down_proj.weight", "key_type": 2}], "value_metadata": {"value_type": "np.ndarray", "skip_deserialize": false}}, "('model.layers.mlp.gate_proj.weight',)": {"key_metadata": [{"key": "model.layers.mlp.gate_proj.weight", "key_type": 2}], "value_metadata": {"value_type": "np.ndarray", "skip_deserialize": false}}, "('model.layers.mlp.up_proj.weight',)": {"key_metadata": [{"key": "model.layers.mlp.up_proj.weight", "key_type": 2}], "value_metadata": {"value_type": "np.ndarray", "skip_deserialize": false}}, "('model.layers.post_attention_layernorm.weight',)": {"key_metadata": [{"key": "model.layers.post_attention_layernorm.weight", "key_type": 2}], "value_metadata": {"value_type": "np.ndarray", "skip_deserialize": false}}, "('model.layers.post_feedforward_layernorm.weight',)": {"key_metadata": [{"key": "model.layers.post_feedforward_layernorm.weight", "key_type": 2}], "value_metadata": {"value_type": "np.ndarray", "skip_deserialize": false}}, "('model.layers.pre_feedforward_layernorm.weight',)": {"key_metadata": [{"key": "model.layers.pre_feedforward_layernorm.weight", "key_type": 2}], "value_metadata": {"value_type": "np.ndarray", "skip_deserialize": false}}, "('model.layers.self_attn.k_norm.weight',)": {"key_metadata": [{"key": "model.layers.self_attn.k_norm.weight", "key_type": 2}], "value_metadata": {"value_type": "np.ndarray", "skip_deserialize": false}}, "('model.layers.self_attn.k_proj.weight',)": {"key_metadata": [{"key": "model.layers.self_attn.k_proj.weight", "key_type": 2}], "value_metadata": {"value_type": "np.ndarray", "skip_deserialize": false}}, "('model.layers.self_attn.o_proj.weight',)": {"key_metadata": [{"key": "model.layers.self_attn.o_proj.weight", "key_type": 2}], "value_metadata": {"value_type": "np.ndarray", "skip_deserialize": false}}, "('model.layers.self_attn.q_norm.weight',)": {"key_metadata": [{"key": "model.layers.self_attn.q_norm.weight", "key_type": 2}], "value_metadata": {"value_type": "np.ndarray", "skip_deserialize": false}}, "('model.layers.self_attn.q_proj.weight',)": {"key_metadata": [{"key": "model.layers.self_attn.q_proj.weight", "key_type": 2}], "value_metadata": {"value_type": "np.ndarray", "skip_deserialize": false}}, "('model.layers.self_attn.v_proj.weight',)": {"key_metadata": [{"key": "model.layers.self_attn.v_proj.weight", "key_type": 2}], "value_metadata": {"value_type": "np.ndarray", "skip_deserialize": false}}, "('model.norm.weight',)": {"key_metadata": [{"key": "model.norm.weight", "key_type": 2}], "value_metadata": {"value_type": "np.ndarray", "skip_deserialize": false}}}, "use_ocdbt": true, "use_zarr3": false, "store_array_data_equal_to_fill_value": true, "custom_metadata": null}
|
commit_success.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Checkpoint commit was successful to gs://gemma-3-1b-pt-orbax-b76114af/gemma-3-1b-pt-orbax
|
d/41c8f074b3399d92d243264bcd7fe38e
ADDED
|
Binary file (747 Bytes). View file
|
|
|
manifest.ocdbt
ADDED
|
Binary file (117 Bytes). View file
|
|
|
ocdbt.process_0/d/763b51d009af4ff959c695b7b95cebac
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:155fa52895013baf4c9a65915f4c7fd83f786ac391e46335b0b0d62b08d87fb1
|
| 3 |
+
size 442245120
|
ocdbt.process_0/d/86298f6c080bc76319a8c1478c4a726f
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b4e511889249815c2d95365be6672fab767f4604f8157b927c4546b00848fcf2
|
| 3 |
+
size 1114181632
|
ocdbt.process_0/d/e52101dba7256673c810a653c9407973
ADDED
|
Binary file (203 Bytes). View file
|
|
|
ocdbt.process_0/d/e61deca8241ff271af8220bc0cbeb47b
ADDED
|
Binary file (491 Bytes). View file
|
|
|
ocdbt.process_0/manifest.ocdbt
ADDED
|
Binary file (260 Bytes). View file
|
|
|