Text Generation
Transformers
Safetensors
English
Chinese
glm_moe_dsa
conversational
Eval Results
8-bit precision
compressed-tensors
Instructions to use RedHatAI/GLM-5.2-MXFP4xMXFP8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use RedHatAI/GLM-5.2-MXFP4xMXFP8 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="RedHatAI/GLM-5.2-MXFP4xMXFP8") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("RedHatAI/GLM-5.2-MXFP4xMXFP8") model = AutoModelForCausalLM.from_pretrained("RedHatAI/GLM-5.2-MXFP4xMXFP8", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use RedHatAI/GLM-5.2-MXFP4xMXFP8 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "RedHatAI/GLM-5.2-MXFP4xMXFP8" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "RedHatAI/GLM-5.2-MXFP4xMXFP8", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/RedHatAI/GLM-5.2-MXFP4xMXFP8
- SGLang
How to use RedHatAI/GLM-5.2-MXFP4xMXFP8 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "RedHatAI/GLM-5.2-MXFP4xMXFP8" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "RedHatAI/GLM-5.2-MXFP4xMXFP8", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "RedHatAI/GLM-5.2-MXFP4xMXFP8" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "RedHatAI/GLM-5.2-MXFP4xMXFP8", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use RedHatAI/GLM-5.2-MXFP4xMXFP8 with Docker Model Runner:
docker model run hf.co/RedHatAI/GLM-5.2-MXFP4xMXFP8
Upload folder using huggingface_hub (part 2)
Browse files- .gitattributes +1 -0
- model-00241-of-00282.safetensors +3 -0
- model-00242-of-00282.safetensors +3 -0
- model-00243-of-00282.safetensors +3 -0
- model-00244-of-00282.safetensors +3 -0
- model-00245-of-00282.safetensors +3 -0
- model-00246-of-00282.safetensors +3 -0
- model-00247-of-00282.safetensors +3 -0
- model-00248-of-00282.safetensors +3 -0
- model-00249-of-00282.safetensors +3 -0
- model-00250-of-00282.safetensors +3 -0
- model-00251-of-00282.safetensors +3 -0
- model-00252-of-00282.safetensors +3 -0
- model-00253-of-00282.safetensors +3 -0
- model-00254-of-00282.safetensors +3 -0
- model-00255-of-00282.safetensors +3 -0
- model-00256-of-00282.safetensors +3 -0
- model-00257-of-00282.safetensors +3 -0
- model-00258-of-00282.safetensors +3 -0
- model-00259-of-00282.safetensors +3 -0
- model-00260-of-00282.safetensors +3 -0
- model-00261-of-00282.safetensors +3 -0
- model-00262-of-00282.safetensors +3 -0
- model-00263-of-00282.safetensors +3 -0
- model-00264-of-00282.safetensors +3 -0
- model-00265-of-00282.safetensors +3 -0
- model-00266-of-00282.safetensors +3 -0
- model-00267-of-00282.safetensors +3 -0
- model-00268-of-00282.safetensors +3 -0
- model-00269-of-00282.safetensors +3 -0
- model-00270-of-00282.safetensors +3 -0
- model-00271-of-00282.safetensors +3 -0
- model-00272-of-00282.safetensors +3 -0
- model-00273-of-00282.safetensors +3 -0
- model-00274-of-00282.safetensors +3 -0
- model-00275-of-00282.safetensors +3 -0
- model-00276-of-00282.safetensors +3 -0
- model-00277-of-00282.safetensors +3 -0
- model-00278-of-00282.safetensors +3 -0
- model-00279-of-00282.safetensors +3 -0
- model-00280-of-00282.safetensors +3 -0
- model-00281-of-00282.safetensors +3 -0
- model-00282-of-00282.safetensors +3 -0
- model.safetensors.index.json +3 -0
- tokenizer.json +3 -0
- tokenizer_config.json +33 -0
.gitattributes
CHANGED
|
@@ -34,3 +34,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
model.safetensors.index.json filter=lfs diff=lfs merge=lfs -text
|
model-00241-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:76408b84c89d0a804b9c9015649e366019c6572d98b881bde1726bd6618b88de
|
| 3 |
+
size 1670202656
|
model-00242-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3b227b2b4640e4b8871ced3d3036a6e4a6945f422fb5385bed92dfbd6a2effd2
|
| 3 |
+
size 1423889888
|
model-00243-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b6704bf45ddbf62d851d4b3a9d22e79e38699ff7ff6fd53f54cf5e99d1a8251a
|
| 3 |
+
size 1423889880
|
model-00244-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6f9fcac6652be1054cc4c16a74c0c1680b879418a0f867648b8cd28296eab4cb
|
| 3 |
+
size 1423889464
|
model-00245-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e35028c2fc5ca6f41befe618ffd5f97be6caafbdd5f2d7291d003b6456d24925
|
| 3 |
+
size 1682262472
|
model-00246-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8d76b66cf30a6f2edc2bf2abcdabf3855de016b91fe00dec0b6be7008cdc6ee4
|
| 3 |
+
size 1423889880
|
model-00247-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ebff22e1c9fa7c44bca24c62dd4c12e3cba815dd28a487effa36ba35b1c8ad81
|
| 3 |
+
size 1423889752
|
model-00248-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d32e7ff9a2d3ce08c3adc045939ae79cb0d60f392dcabd8a252b0f8c7f4da1a6
|
| 3 |
+
size 1670202696
|
model-00249-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:11b93c7e1739d2aca3c43b268d47cb7f81ef7bce9dadb67bbe36de03c97748f4
|
| 3 |
+
size 1423889896
|
model-00250-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dde603d23edceedbc218bbb23ad65873f2d6ef5388badd6e5a6297f587f0dfa6
|
| 3 |
+
size 1423889880
|
model-00251-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:098cc1c359b01129e1eba775a6b4ac7fecf8297c29b174201a16c97abfcae841
|
| 3 |
+
size 1423889616
|
model-00252-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8fa3b908dfd01e2b3ec470b951e7132ba6de46edc5735e3c4d74b13ca07841f0
|
| 3 |
+
size 1670202832
|
model-00253-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:376874037c181c5468b39e2e03cb3240dbf677c467505532689ebab8229f7562
|
| 3 |
+
size 1423889888
|
model-00254-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:64fffb0a6efd23bf7472eabb04c1dfc350d1d18100fa8b239801b3874160daa6
|
| 3 |
+
size 1423889888
|
model-00255-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:aa2fbd5b88f5b278da154f4e2d245d76951bccc5543034f8f18a050b8ffa7a68
|
| 3 |
+
size 1423889480
|
model-00256-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:34960176925a5ab6eb0a6391553e7f484d048c5a85bcddd4e442f44f8e5a80df
|
| 3 |
+
size 1670202968
|
model-00257-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5a1b3f1623024663e12390113098e0de5dc7d0648f09d0dbaf1be3d8aa6094d9
|
| 3 |
+
size 1423889880
|
model-00258-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1f1671a8a34910a2e8c64ddb03dbd79ba0294c33032abe382a9945c5446b7b5a
|
| 3 |
+
size 1423889768
|
model-00259-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8f4868642348e8789e2c86dfa9f3727ec39e4481a8246f84ce39f0ec7f9c5891
|
| 3 |
+
size 1682262152
|
model-00260-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2fa7a9957097dca554d3641e8542e90e46bcdaa670ddae6ab2e78ed491aa40aa
|
| 3 |
+
size 1423889896
|
model-00261-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f00c8174b8072298ae42653151196bba0dd514c6ea0bb89977c2335f0216340b
|
| 3 |
+
size 1423889880
|
model-00262-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4ee5fbca314f456fa3ea75da9511353f977e161becf0e8c13c707c6964e39f48
|
| 3 |
+
size 1423889640
|
model-00263-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4211a550f89a34f4e77f8054303b2090d4f98840b4100b3e1ce584d872aecca9
|
| 3 |
+
size 1670202816
|
model-00264-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:59f3fa8f1a49078216c53e5c092c3b4ead50224a96f0079412daee32a6619bcd
|
| 3 |
+
size 1423889896
|
model-00265-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cb5ad4bf66189f5ebe8a4f1001a947acbd31c14c49457de12816bed8e061e541
|
| 3 |
+
size 1423889880
|
model-00266-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b85d2b47bd5c1253023d643bd34e9cae9e5491e72c9e3c5971a36fb1207837b2
|
| 3 |
+
size 1423889504
|
model-00267-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:82a7ecb7335f84414f8eca1071ceed26a465fd3d191398d5f8abcf97dbc49e01
|
| 3 |
+
size 1670202944
|
model-00268-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c17fcc5f22c12dd5385025fecdc95e065cc5cda051f7efaec2ad0b3798333d41
|
| 3 |
+
size 1423889888
|
model-00269-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:957bba3fbac5d7a82b68975c114be68875e7951f1bf97ac97c9022c545ce82ea
|
| 3 |
+
size 1423889784
|
model-00270-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4d2f460d64c7768336e6e3d3a45365a43f28b4ff88f2b169b089b8ff931fb0a8
|
| 3 |
+
size 1670226128
|
model-00271-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ee1fb69f2e2620242e6faf39e2f712d92a762727e8ef2cd854fd8e8868f07037
|
| 3 |
+
size 1423889864
|
model-00272-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d2802c5c6126874ea4ad8240698a7fd824388a96eec65aae931ca8bb3cc9375c
|
| 3 |
+
size 1423889888
|
model-00273-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b9f2be2d328feb7b961c96b6b4852f311c9b2db4b231a211520b724772a018af
|
| 3 |
+
size 1423889664
|
model-00274-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3ae55ee4bce55ce78e9bb35c75a1050c23a577cc5612228a1eb1d00969ea94d4
|
| 3 |
+
size 1682274528
|
model-00275-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c15df71ae77c666fa4e2031b78b2d5ce34223f64149c419dfbb7a7f8c45c3ccf
|
| 3 |
+
size 1423889464
|
model-00276-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:00c438998d259775deced3574950ac0328d6e397188cc750f81b1fee5d4086f4
|
| 3 |
+
size 1423889456
|
model-00277-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:762d7e887da29176ef7808c3d2ec57d335bc9f3c7e4723941a6e75e812ca0cc1
|
| 3 |
+
size 1423889104
|
model-00278-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:98af5e4460c6a42811598ef5b4d7bcd834ba6e505be13f8d0b59f9a52a857ccd
|
| 3 |
+
size 1670202512
|
model-00279-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:78077014803e5675fef58a12804013671ef16faf4f10a9bd0d4de8cb4fd1f117
|
| 3 |
+
size 1423889456
|
model-00280-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bdee58cebf32e00d951a983d7bc42243bb419f80104327d1e75b53c1285aa1a6
|
| 3 |
+
size 1423889400
|
model-00281-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:779fdaf1c1d1a576169e140b5002f4068b35f11e4af195a112d7bf96ccf6e3dd
|
| 3 |
+
size 1443433088
|
model-00282-of-00282.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:46c23d3a25db83ab8b7e47d0a5efec49e00f57a815358323f1ab45136de327d7
|
| 3 |
+
size 293618224
|
model.safetensors.index.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:53fcd97c5cf93c678f14dafd0596bbbf8f97b84581986841ea304521cfd3d442
|
| 3 |
+
size 11491841
|
tokenizer.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:19e773648cb4e65de8660ea6365e10acca112d42a854923df93db4a6f333a82d
|
| 3 |
+
size 20217442
|
tokenizer_config.json
ADDED
|
@@ -0,0 +1,33 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"backend": "tokenizers",
|
| 3 |
+
"clean_up_tokenization_spaces": false,
|
| 4 |
+
"do_lower_case": false,
|
| 5 |
+
"eos_token": "<|endoftext|>",
|
| 6 |
+
"extra_special_tokens": [
|
| 7 |
+
"<|endoftext|>",
|
| 8 |
+
"[MASK]",
|
| 9 |
+
"[gMASK]",
|
| 10 |
+
"[sMASK]",
|
| 11 |
+
"<sop>",
|
| 12 |
+
"<eop>",
|
| 13 |
+
"<|system|>",
|
| 14 |
+
"<|user|>",
|
| 15 |
+
"<|assistant|>",
|
| 16 |
+
"<|observation|>",
|
| 17 |
+
"<|begin_of_image|>",
|
| 18 |
+
"<|end_of_image|>",
|
| 19 |
+
"<|begin_of_video|>",
|
| 20 |
+
"<|end_of_video|>",
|
| 21 |
+
"<|begin_of_audio|>",
|
| 22 |
+
"<|end_of_audio|>",
|
| 23 |
+
"<|begin_of_transcription|>",
|
| 24 |
+
"<|end_of_transcription|>"
|
| 25 |
+
],
|
| 26 |
+
"is_local": true,
|
| 27 |
+
"model_max_length": 1048576,
|
| 28 |
+
"model_specific_special_tokens": {},
|
| 29 |
+
"pad_token": "<|endoftext|>",
|
| 30 |
+
"padding_side": "left",
|
| 31 |
+
"remove_space": false,
|
| 32 |
+
"tokenizer_class": "TokenizersBackend"
|
| 33 |
+
}
|