anas danielhanchen commited on
Commit
0f09cc3
·
0 Parent(s):

Duplicate from unsloth/grok-2

Browse files

Co-authored-by: Daniel (Unsloth) <danielhanchen@users.noreply.huggingface.co>

This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +36 -0
  2. LICENSE +39 -0
  3. README.md +68 -0
  4. chat_template.jinja +7 -0
  5. config.json +63 -0
  6. model-00000-TP-common.safetensors +3 -0
  7. model-00001-TP-common.safetensors +3 -0
  8. model-00002-TP-common.safetensors +3 -0
  9. model-00003-TP-common.safetensors +3 -0
  10. model-00004-TP-common.safetensors +3 -0
  11. model-00005-TP-common.safetensors +3 -0
  12. model-00006-TP-000.safetensors +3 -0
  13. model-00006-TP-001.safetensors +3 -0
  14. model-00006-TP-002.safetensors +3 -0
  15. model-00006-TP-003.safetensors +3 -0
  16. model-00006-TP-004.safetensors +3 -0
  17. model-00006-TP-005.safetensors +3 -0
  18. model-00006-TP-006.safetensors +3 -0
  19. model-00006-TP-007.safetensors +3 -0
  20. model-00007-TP-000.safetensors +3 -0
  21. model-00007-TP-001.safetensors +3 -0
  22. model-00007-TP-002.safetensors +3 -0
  23. model-00007-TP-003.safetensors +3 -0
  24. model-00007-TP-004.safetensors +3 -0
  25. model-00007-TP-005.safetensors +3 -0
  26. model-00007-TP-006.safetensors +3 -0
  27. model-00007-TP-007.safetensors +3 -0
  28. model-00008-TP-000.safetensors +3 -0
  29. model-00008-TP-001.safetensors +3 -0
  30. model-00008-TP-002.safetensors +3 -0
  31. model-00008-TP-003.safetensors +3 -0
  32. model-00008-TP-004.safetensors +3 -0
  33. model-00008-TP-005.safetensors +3 -0
  34. model-00008-TP-006.safetensors +3 -0
  35. model-00008-TP-007.safetensors +3 -0
  36. model-00009-TP-common.safetensors +3 -0
  37. model-00010-TP-common.safetensors +3 -0
  38. model-00011-TP-common.safetensors +3 -0
  39. model-00012-TP-common.safetensors +3 -0
  40. model-00013-TP-common.safetensors +3 -0
  41. model-00014-TP-common.safetensors +3 -0
  42. model-00015-TP-common.safetensors +3 -0
  43. model-00016-TP-common.safetensors +3 -0
  44. model-00017-TP-common.safetensors +3 -0
  45. pytorch_model-00000-TP-common.safetensors +3 -0
  46. pytorch_model-00001-TP-common.safetensors +3 -0
  47. pytorch_model-00002-TP-common.safetensors +3 -0
  48. pytorch_model-00003-TP-common.safetensors +3 -0
  49. pytorch_model-00004-TP-common.safetensors +3 -0
  50. pytorch_model-00005-TP-common.safetensors +3 -0
.gitattributes ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
LICENSE ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Grok 2 Community License Agreement
2
+ Last Updated: August 23, 2025
3
+
4
+ 1. Background and Definitions
5
+ By downloading, accessing, or using the Materials (as defined below) relating to Grok 2 provided by X.AI LLC (“xAI”), you (“Licensee” or “you”) agree to the terms of this agreement (“Agreement”). If you accept this Agreement for or on behalf of an entity, you represent that you have the authority to bind that entity. As used in this Agreement, “Materials” means the Grok 2 materials provided to you by xAI under this Agreement, consisting of: (1) one or more machine learning models (including architecture and parameters); and (2) related artifacts (including associated data, documentation, and software) that are provided to you hereunder.
6
+
7
+ 2. License Grant & Scope
8
+ a. Permitted Uses: xAI grants you a non-exclusive, worldwide, revocable license to use, reproduce, distribute, and modify the Materials:
9
+ • For non-commercial and research purposes; and
10
+ • For commercial use solely if you and your affiliates abide by all of the guardrails provided in xAI's Acceptable Use Policy (https://x.ai/legal/acceptable-use-policy), including 1. Comply with the law, 2. Do not harm people or property, and 3. Respect guardrails and don't mislead.
11
+ b. Restrictions:
12
+ • You may not use the Materials, derivatives, or outputs (including generated data) to train, create, or improve any foundational, large language, or general-purpose AI models, except for modifications or fine-tuning of Grok 2 permitted under and in accordance with the terms of this Agreement.
13
+ • No right to use xAI’s trademarks is granted, except as required for attribution (see below).
14
+
15
+ 3. Distribution & Attribution
16
+ If you distribute the Materials, derivatives, or products/services incorporating them:
17
+ • Include this Agreement and a notice stating: “This product includes materials licensed under the xAI Community License. Copyright © 2025 xAI. All rights reserved.”
18
+ • Prominently display “Powered by xAI” in related materials or interfaces.
19
+
20
+ 4. Ownership & Outputs
21
+ xAI retains all rights in the Materials. This Agreement does not impose any restrictions or obligations with respect to any use, modification, or sharing of any outputs generated by using the Materials. If you provide feedback, suggestions, or ideas, you grant xAI a perpetual, worldwide, irrevocable, royalty-free license to use and incorporate that feedback without restriction.
22
+
23
+ 5. Acceptable Use
24
+ You are responsible for implementing appropriate safety measures, including filters and human oversight, suitable for your use case. You must comply with xAI’s Acceptable Use Policy (AUP), as well as all applicable laws. You may not use the Materials for illegal, harmful, or abusive activities.
25
+
26
+ 6. Warranty Disclaimer & Limitation of Liability
27
+ THE MATERIALS ARE PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, TITLE, NONINFRINGEMENT, ACCURACY, OR THE ABSENCE OF LATENT OR OTHER DEFECTS OR ERRORS, WHETHER OR NOT DISCOVERABLE, ALL TO THE GREATEST EXTENT PERMISSIBLE UNDER APPLICABLE LAW.
28
+ YOU ARE SOLELY RESPONSIBLE FOR (1) CLEARING RIGHTS OF OTHER PERSONS THAT MAY APPLY TO THE MATERIALS OR ANY USE THEREOF, INCLUDING WITHOUT LIMITATION ANY PERSON'S COPYRIGHTS OR OTHER RIGHTS INCLUDED OR EMBODIED IN THE MATERIALS; (2) OBTAINING ANY NECESSARY CONSENTS, PERMISSIONS OR OTHER RIGHTS REQUIRED FOR ANY USE OF THE MATERIALS; OR (3) PERFORMING ANY DUE DILIGENCE OR UNDERTAKING ANY OTHER INVESTIGATIONS INTO THE MATERIALS OR ANYTHING INCORPORATED OR EMBODIED THEREIN.
29
+ IN NO EVENT SHALL XAI BE LIABLE FOR ANY CLAIM, DAMAGES, OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT, OR OTHERWISE, ARISING FROM, OUT OF, OR IN CONNECTION WITH THE MATERIALS, THE USE THEREOF, OR OTHER DEALINGS THEREIN. TO THE MAXIMUM EXTENT PERMITTED BY LAW, XAI WILL NOT BE LIABLE FOR ANY INDIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES, OR FOR AGGREGATE LIABILITY EXCEEDING $100, REGARDLESS OF THE LEGAL THEORY.
30
+
31
+ 7. Termination
32
+ This license terminates immediately upon your breach or if you exceed the permitted commercial threshold. Upon termination, you must cease all use and delete all copies of the Materials and derivatives.
33
+ Additionally, if you file, maintain, or voluntarily participate in a lawsuit against any person or entity alleging that the Materials, or any part thereof, directly or indirectly infringe any patent, then your license under this Agreement shall immediately terminate. This does not apply to a lawsuit brought in response to a corresponding lawsuit first filed against you.
34
+
35
+ 8. Governing Law
36
+ The laws of Texas govern this Agreement, and any dispute shall be resolved exclusively in the courts located in Tarrant County, Texas.
37
+
38
+ 9. Miscellaneous
39
+ This Agreement is the entire agreement between the parties on this subject. Failure to enforce any provision is not a waiver. If any provision is unenforceable, the remainder remains in effect. xAI may assign this Agreement, including in connection with a merger or acquisition. Licensee may not assign this Agreement without xAI’s prior written consent. This Agreement creates no third-party beneficiaries. You must comply with all applicable export control, trade compliance, and sanctions laws.
README.md ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ tags:
4
+ - tokenizers
5
+ - sglang
6
+ license: other
7
+ license_name: grok-2
8
+ license_link: https://huggingface.co/xai-org/grok-2/blob/main/LICENSE
9
+ ---
10
+
11
+ # Grok-2 Tokenizer
12
+
13
+ A 🤗-compatible version of the **Grok-2 tokenizer** (adapted from [xai-org/grok-2](https://huggingface.co/xai-org/grok-2)).
14
+
15
+ This means it can be used with Hugging Face libraries including [Transformers](https://github.com/huggingface/transformers),
16
+ [Tokenizers](https://github.com/huggingface/tokenizers), and [Transformers.js](https://github.com/xenova/transformers.js).
17
+
18
+ ## Motivation
19
+
20
+ As Grok 2.5 aka. [xai-org/grok-2](https://github.com/xai-org/grok-2) has been recently released on the 🤗 Hub with [SGLang](https://github.com/sgl-project/sglang)
21
+ native support, but the checkpoints on the Hub won't come with a Hugging Face compatible tokenizer, but rather with a `tiktoken`-based
22
+ JSON export, which is [internally read and patched in SGLang](https://github.com/sgl-project/sglang/blob/fd71b11b1d96d385b09cb79c91a36f1f01293639/python/sglang/srt/tokenizer/tiktoken_tokenizer.py#L29-L108).
23
+
24
+ This repository then contains the Hugging Face compatible export so that users can easily interact and play around with the Grok-2 tokenizer,
25
+ besides that allowing to use it via SGLang without having to pull the repository manually from the Hub and then using a mount, to prevent from directly having
26
+ to point to the tokenizer path, so that Grok-2 can be deployed as:
27
+
28
+ ```bash
29
+ python3 -m sglang.launch_server --model-path xai-org/grok-2 --tokenizer-path alvarobartt/grok-2-tokenizer --tp-size 8 --quantization fp8 --attention-backend triton
30
+ ```
31
+
32
+ Rather than the former 2-step process:
33
+
34
+ ```bash
35
+ hf download xai-org/grok-2 --local-dir /local/grok-2
36
+
37
+ python3 -m sglang.launch_server --model-path /local/grok-2 --tokenizer-path /local/grok-2/tokenizer.tok.json --tp-size 8 --quantization fp8 --attention-backend triton
38
+ ```
39
+
40
+ ## Example
41
+
42
+ ```py
43
+ from transformers import AutoTokenizer
44
+
45
+ tokenizer = AutoTokenizer.from_pretrained("alvarobartt/grok-2-tokenizer")
46
+
47
+ assert tokenizer.encode("Human: What is Deep Learning?<|separator|>\n\n") == [
48
+ 35406,
49
+ 186,
50
+ 2171,
51
+ 458,
52
+ 17454,
53
+ 14803,
54
+ 191,
55
+ 1,
56
+ 417,
57
+ ]
58
+
59
+ assert (
60
+ tokenizer.apply_chat_template(
61
+ [{"role": "user", "content": "What is the capital of France?"}], tokenize=False
62
+ )
63
+ == "Human: What is the capital of France?<|separator|>\n\n"
64
+ )
65
+ ```
66
+
67
+ > [!NOTE]
68
+ > This repository has been inspired by earlier similar work by [Xenova](https://huggingface.co/Xenova) in [`Xenova/grok-1-tokenizer`](https://huggingface.co/Xenova/grok-1-tokenizer).
chat_template.jinja ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {% for message in messages %}{% if message['role'] == 'user' %}{{ 'Human: ' + message['content'].strip() + '<|separator|>
2
+
3
+ ' }}{% elif message['role'] == 'system' %}{{ 'System: ' + message['content'].strip() + '<|separator|>
4
+
5
+ ' }}{% elif message['role'] == 'assistant' %}{{ 'Assistant: ' + message['content'] + '<|separator|>
6
+
7
+ ' }}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ 'Assistant:' }}{% endif %}
config.json ADDED
@@ -0,0 +1,63 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "Grok1ForCausalLM"
4
+ ],
5
+ "attention_probs_dropout_prob": 0.1,
6
+ "attn_factor": 1.0,
7
+ "attn_logit_softcapping": 30.0,
8
+ "attn_temperature_len": 1024,
9
+ "beta_fast": 8,
10
+ "beta_slow": 1,
11
+ "dtype": "bfloat16",
12
+ "embedding_multiplier_scale": 90.50966799187809,
13
+ "eos_token_id": 102,
14
+ "extrapolation_factor": 1.0,
15
+ "final_logit_softcapping": 50,
16
+ "global_attn_every_n": 1,
17
+ "head_dim": 128,
18
+ "hidden_act": "gelu",
19
+ "hidden_dropout_prob": 0.1,
20
+ "hidden_size": 8192,
21
+ "initializer_range": 0.02,
22
+ "intermediate_size": 32768,
23
+ "layer_norm_eps": 1e-12,
24
+ "max_position_embeddings": 131072,
25
+ "model_type": "git",
26
+ "moe_intermediate_size": 16384,
27
+ "num_attention_heads": 64,
28
+ "num_experts_per_tok": 2,
29
+ "num_hidden_layers": 64,
30
+ "num_image_with_embedding": null,
31
+ "num_key_value_heads": 8,
32
+ "num_local_experts": 8,
33
+ "original_max_position_embeddings": 8192,
34
+ "output_multiplier_scale": 0.5,
35
+ "pad_token_id": 0,
36
+ "position_embedding_type": "absolute",
37
+ "residual_moe": true,
38
+ "rms_norm_eps": 1e-05,
39
+ "rope_theta": 208533496,
40
+ "rope_type": "original",
41
+ "router_logit_softcapping": 30.0,
42
+ "scaling_factor": 16.0,
43
+ "sliding_window_size": -1,
44
+ "tie_word_embeddings": false,
45
+ "transformers_version": "4.56.1",
46
+ "unsloth_fixed": true,
47
+ "use_cache": true,
48
+ "vision_config": {
49
+ "attention_dropout": 0.0,
50
+ "hidden_act": "quick_gelu",
51
+ "hidden_size": 768,
52
+ "image_size": 224,
53
+ "initializer_range": 0.02,
54
+ "intermediate_size": 3072,
55
+ "layer_norm_eps": 1e-05,
56
+ "model_type": "git_vision_model",
57
+ "num_attention_heads": 12,
58
+ "num_channels": 3,
59
+ "num_hidden_layers": 12,
60
+ "patch_size": 16
61
+ },
62
+ "vocab_size": 131072
63
+ }
model-00000-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:315d2eb626636477b35a19c60b481ae43b70fc7b9d24645255ded00cecf2a6bb
3
+ size 2147483760
model-00001-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f8001b2d7baaee0bd5bce3ad41d117148c591e485dc8a838b8abccb650ef9bb
3
+ size 2147483744
model-00002-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e41eeadefc5da657bac925e752dab11672d7ccee729ed60df8c32df60c6fcd6e
3
+ size 16472
model-00003-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5117eeb28c1447403df924fa93c62a9ea09d2d6fa773e27367fc5e6687b10b99
3
+ size 34359745872
model-00004-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6921cc3380cfbd783a3b52bccf81bc5c7c645548f9f2f1b86279649edbba3cf0
3
+ size 34359745872
model-00005-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90bb1c9d09d31b58becb2cf13f1694166708a52cd97315185c6a7ddbcc64f1ca
3
+ size 34359745744
model-00006-TP-000.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5128445f49d89ed53463d6e454ef9f466ca65e2607a006761a558f9fd60754d
3
+ size 17179936544
model-00006-TP-001.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9f0869351c7a2baac725b2b2903dec79b9afb0f49f2004ce3a1f35763708e40
3
+ size 17179936544
model-00006-TP-002.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:930f397a72ed323783e3f029bc1252beb9f2d2bce69610fa0f094e361547d1dc
3
+ size 17179936544
model-00006-TP-003.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b266d9293692e69cc2decbf1914916cde492de8b485e7ad670447674e5170e49
3
+ size 17179936544
model-00006-TP-004.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be0f2daffdc5a7c031ce685cc5bd89fe9058eedb14a107855ea45e272b7022c0
3
+ size 17179936544
model-00006-TP-005.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4697b87056edc930ec836528985fb25a40040417226e47a9c483786b81b56a7d
3
+ size 17179936544
model-00006-TP-006.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d572dc1910937e16be0017118daca90734af892ea019581584c738abd74975d
3
+ size 17179936544
model-00006-TP-007.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cddca91357cc76894e1704d0bba02dcddeb7e063329f30198a26f3eec98f1ca1
3
+ size 17179936544
model-00007-TP-000.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ca76131b44751d11ba6abafa0567939812c83af63ff3ed91771e5a03b28e395
3
+ size 17179936544
model-00007-TP-001.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6689603a91fec740d69a67512a7d6c3d4176a2068fcc88e08a79646c7bc9a4ec
3
+ size 17179936544
model-00007-TP-002.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91c5af3bc69e126adf09cf066b5554fd55a804cb246e48c769725044bf6c2482
3
+ size 17179936544
model-00007-TP-003.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1643a8a743dd135e3aa082cb732ade54c624e188e264ce2ca29818eca4579129
3
+ size 17179936544
model-00007-TP-004.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1cce342c135799ea961f7c7335e1bd485190e7ed4511f1a4b25792af856b702b
3
+ size 17179936544
model-00007-TP-005.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ecb1e412e72be6acf5a94300d20b922440710dbc3ff655081e14fde52dead193
3
+ size 17179936544
model-00007-TP-006.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff8c1dc7ba5222e7e88eeaa8c71f9bcc6c72abb2642cd53708e89c3bb29e9a5e
3
+ size 17179936544
model-00007-TP-007.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d890e53bae6eb64606791a70ec4055a0909eb75d704bc505050f87a8f4304776
3
+ size 17179936544
model-00008-TP-000.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6023ef14f89644bba6dea2b3cd268ef90a603a724e58e6f25fa4b35e09da805
3
+ size 17179936544
model-00008-TP-001.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:adf26b682c3898af5f1ab6fe106579d29aea00ab661e8d164988b6e8093f6412
3
+ size 17179936544
model-00008-TP-002.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8381e5ff848f33a2a715155aec5303309d1044bb105d0267bbbbd702e2ea4181
3
+ size 17179936544
model-00008-TP-003.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38471f261ce898dc7d1266fbabbacd922248767d4e909a0f431d2adaf77c9d1f
3
+ size 17179936544
model-00008-TP-004.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22d33701fa88dff2ecadb388238a12c7a5d63c6de2dae120ae98ffacca109683
3
+ size 17179936544
model-00008-TP-005.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:abdaa52c585fe182cd82918bde1ec3fa2b12033a1c9c11cebd753a2b3db88355
3
+ size 17179936544
model-00008-TP-006.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f50b318ba532e0032bd6f25b59b54852029e6a026ef19852baa7851b6d5d7004
3
+ size 17179936544
model-00008-TP-007.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7846ffc97ad222ca88bb38771a97409e8a80b62ce3573c096378a76f97c54578
3
+ size 17179936544
model-00009-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cebb4ddcdb6520cb50dabdb0a5568e83de081dbebb00208e2a44afd82fd3c352
3
+ size 1073749240
model-00010-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db9376f06a12092da29d028c2ebfe1206b1c85c50513d5138e7442f02ede635c
3
+ size 8589942120
model-00011-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1306ca738a956652a3d6bea2df5f3899d0c42dd96f22d75c62f72792f236d7a7
3
+ size 8589942120
model-00012-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88ca01f2876be5a7b268f0cd068a8e49bc9daae48426322bb420eacfcf308703
3
+ size 1073749240
model-00013-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:924822ee882d55ac56938342ca435bcd2c4e71a7116dba90e6301845ab19f509
3
+ size 1055096
model-00014-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:658fddf97d85edcd527861c7785d9d4a7801d09799819f9de85aa7b2d29ecf9e
3
+ size 1055160
model-00015-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc94f4dff86cad956d7eae017ff7219d55e2d902d45378fb5502729020376c30
3
+ size 1055032
model-00016-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63b443a0a63169c76e6342304583351a50a571ce45070f32650ec0da0f8de08b
3
+ size 1055096
model-00017-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49021a8d7c657eedb8bb83de222fe9d8015cb1db2388ee2e02ad017b1d289f32
3
+ size 8395888
pytorch_model-00000-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:315d2eb626636477b35a19c60b481ae43b70fc7b9d24645255ded00cecf2a6bb
3
+ size 2147483760
pytorch_model-00001-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f8001b2d7baaee0bd5bce3ad41d117148c591e485dc8a838b8abccb650ef9bb
3
+ size 2147483744
pytorch_model-00002-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e41eeadefc5da657bac925e752dab11672d7ccee729ed60df8c32df60c6fcd6e
3
+ size 16472
pytorch_model-00003-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5117eeb28c1447403df924fa93c62a9ea09d2d6fa773e27367fc5e6687b10b99
3
+ size 34359745872
pytorch_model-00004-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6921cc3380cfbd783a3b52bccf81bc5c7c645548f9f2f1b86279649edbba3cf0
3
+ size 34359745872
pytorch_model-00005-TP-common.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90bb1c9d09d31b58becb2cf13f1694166708a52cd97315185c6a7ddbcc64f1ca
3
+ size 34359745744