Text Generation
Transformers
Safetensors
MLX
English
Chinese
glm4_moe
abliteration
SOTA Abliteration Pipeline - PRISM
glm
quantized
finetuned
uncensored
abliterated
mlx-my-repo
conversational
6-bit
Instructions to use cs2764/GLM-4.7-PRISM-mlx-6Bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use cs2764/GLM-4.7-PRISM-mlx-6Bit with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="cs2764/GLM-4.7-PRISM-mlx-6Bit") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("cs2764/GLM-4.7-PRISM-mlx-6Bit") model = AutoModelForCausalLM.from_pretrained("cs2764/GLM-4.7-PRISM-mlx-6Bit", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - MLX
How to use cs2764/GLM-4.7-PRISM-mlx-6Bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("cs2764/GLM-4.7-PRISM-mlx-6Bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- vLLM
How to use cs2764/GLM-4.7-PRISM-mlx-6Bit with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "cs2764/GLM-4.7-PRISM-mlx-6Bit" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "cs2764/GLM-4.7-PRISM-mlx-6Bit", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/cs2764/GLM-4.7-PRISM-mlx-6Bit
- SGLang
How to use cs2764/GLM-4.7-PRISM-mlx-6Bit with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "cs2764/GLM-4.7-PRISM-mlx-6Bit" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "cs2764/GLM-4.7-PRISM-mlx-6Bit", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "cs2764/GLM-4.7-PRISM-mlx-6Bit" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "cs2764/GLM-4.7-PRISM-mlx-6Bit", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Pi
How to use cs2764/GLM-4.7-PRISM-mlx-6Bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "cs2764/GLM-4.7-PRISM-mlx-6Bit"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "cs2764/GLM-4.7-PRISM-mlx-6Bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use cs2764/GLM-4.7-PRISM-mlx-6Bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "cs2764/GLM-4.7-PRISM-mlx-6Bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "cs2764/GLM-4.7-PRISM-mlx-6Bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "cs2764/GLM-4.7-PRISM-mlx-6Bit", "messages": [ {"role": "user", "content": "Hello"} ] }' - Docker Model Runner
How to use cs2764/GLM-4.7-PRISM-mlx-6Bit with Docker Model Runner:
docker model run hf.co/cs2764/GLM-4.7-PRISM-mlx-6Bit
- Hermes Agent
How to use cs2764/GLM-4.7-PRISM-mlx-6Bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "cs2764/GLM-4.7-PRISM-mlx-6Bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default cs2764/GLM-4.7-PRISM-mlx-6Bit
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use cs2764/GLM-4.7-PRISM-mlx-6Bit with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "cs2764/GLM-4.7-PRISM-mlx-6Bit"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "cs2764/GLM-4.7-PRISM-mlx-6Bit" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Add files using upload-large-folder tool
Browse filesThis view is limited to 50 files because it contains too many changes. See raw diff
- .cache/._huggingface +0 -0
- .gitattributes +1 -0
- README.md +54 -0
- chat_template.jinja +86 -0
- config.json +53 -0
- generation_config.json +10 -0
- model-00001-of-00054.safetensors +3 -0
- model-00002-of-00054.safetensors +3 -0
- model-00003-of-00054.safetensors +3 -0
- model-00004-of-00054.safetensors +3 -0
- model-00005-of-00054.safetensors +3 -0
- model-00006-of-00054.safetensors +3 -0
- model-00007-of-00054.safetensors +3 -0
- model-00008-of-00054.safetensors +3 -0
- model-00009-of-00054.safetensors +3 -0
- model-00010-of-00054.safetensors +3 -0
- model-00011-of-00054.safetensors +3 -0
- model-00012-of-00054.safetensors +3 -0
- model-00013-of-00054.safetensors +3 -0
- model-00014-of-00054.safetensors +3 -0
- model-00015-of-00054.safetensors +3 -0
- model-00016-of-00054.safetensors +3 -0
- model-00017-of-00054.safetensors +3 -0
- model-00018-of-00054.safetensors +3 -0
- model-00019-of-00054.safetensors +3 -0
- model-00020-of-00054.safetensors +3 -0
- model-00021-of-00054.safetensors +3 -0
- model-00023-of-00054.safetensors +3 -0
- model-00024-of-00054.safetensors +3 -0
- model-00026-of-00054.safetensors +3 -0
- model-00029-of-00054.safetensors +3 -0
- model-00037-of-00054.safetensors +3 -0
- model-00039-of-00054.safetensors +3 -0
- model-00040-of-00054.safetensors +3 -0
- model-00041-of-00054.safetensors +3 -0
- model-00042-of-00054.safetensors +3 -0
- model-00043-of-00054.safetensors +3 -0
- model-00044-of-00054.safetensors +3 -0
- model-00045-of-00054.safetensors +3 -0
- model-00046-of-00054.safetensors +3 -0
- model-00047-of-00054.safetensors +3 -0
- model-00048-of-00054.safetensors +3 -0
- model-00049-of-00054.safetensors +3 -0
- model-00050-of-00054.safetensors +3 -0
- model-00051-of-00054.safetensors +3 -0
- model-00052-of-00054.safetensors +3 -0
- model-00053-of-00054.safetensors +3 -0
- model-00054-of-00054.safetensors +3 -0
- model.safetensors.index.json +0 -0
- tokenizer.json +3 -0
.cache/._huggingface
ADDED
|
Binary file (4.1 kB). View file
|
|
|
.gitattributes
CHANGED
|
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
|
@@ -0,0 +1,54 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
base_model: Ex0bit/GLM-4.7-PRISM
|
| 4 |
+
model_name: Elbaz-GLM-4.7-PRISM
|
| 5 |
+
tags:
|
| 6 |
+
- abliteration
|
| 7 |
+
- SOTA Abliteration Pipeline - PRISM
|
| 8 |
+
- glm
|
| 9 |
+
- glm4_moe
|
| 10 |
+
- quantized
|
| 11 |
+
- finetuned
|
| 12 |
+
- uncensored
|
| 13 |
+
- abliterated
|
| 14 |
+
- mlx
|
| 15 |
+
- mlx-my-repo
|
| 16 |
+
language:
|
| 17 |
+
- en
|
| 18 |
+
- zh
|
| 19 |
+
library_name: transformers
|
| 20 |
+
pipeline_tag: text-generation
|
| 21 |
+
---
|
| 22 |
+
|
| 23 |
+
# cs2764/GLM-4.7-PRISM-mlx-6Bit
|
| 24 |
+
|
| 25 |
+
The Model [cs2764/GLM-4.7-PRISM-mlx-6Bit](https://huggingface.co/cs2764/GLM-4.7-PRISM-mlx-6Bit) was converted to MLX format from [Ex0bit/GLM-4.7-PRISM](https://huggingface.co/Ex0bit/GLM-4.7-PRISM) using mlx-lm version **0.30.4**.
|
| 26 |
+
|
| 27 |
+
## Quantization Details
|
| 28 |
+
|
| 29 |
+
This model was converted with the following quantization settings:
|
| 30 |
+
|
| 31 |
+
- **Quantization Strategy**: 6-bit quantization
|
| 32 |
+
- **Average bits per weight**: 6.502
|
| 33 |
+
|
| 34 |
+
## Use with mlx
|
| 35 |
+
|
| 36 |
+
```bash
|
| 37 |
+
pip install mlx-lm
|
| 38 |
+
```
|
| 39 |
+
|
| 40 |
+
```python
|
| 41 |
+
from mlx_lm import load, generate
|
| 42 |
+
|
| 43 |
+
model, tokenizer = load("cs2764/GLM-4.7-PRISM-mlx-6Bit")
|
| 44 |
+
|
| 45 |
+
prompt="hello"
|
| 46 |
+
|
| 47 |
+
if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
|
| 48 |
+
messages = [{"role": "user", "content": prompt}]
|
| 49 |
+
prompt = tokenizer.apply_chat_template(
|
| 50 |
+
messages, tokenize=False, add_generation_prompt=True
|
| 51 |
+
)
|
| 52 |
+
|
| 53 |
+
response = generate(model, tokenizer, prompt=prompt, verbose=True)
|
| 54 |
+
```
|
chat_template.jinja
ADDED
|
@@ -0,0 +1,86 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
[gMASK]<sop>
|
| 2 |
+
{%- if tools -%}
|
| 3 |
+
<|system|>
|
| 4 |
+
# Tools
|
| 5 |
+
|
| 6 |
+
You may call one or more functions to assist with the user query.
|
| 7 |
+
|
| 8 |
+
You are provided with function signatures within <tools></tools> XML tags:
|
| 9 |
+
<tools>
|
| 10 |
+
{% for tool in tools %}
|
| 11 |
+
{{ tool | tojson(ensure_ascii=False) }}
|
| 12 |
+
{% endfor %}
|
| 13 |
+
</tools>
|
| 14 |
+
|
| 15 |
+
For each function call, output the function name and arguments within the following XML format:
|
| 16 |
+
<tool_call>{function-name}<arg_key>{arg-key-1}</arg_key><arg_value>{arg-value-1}</arg_value><arg_key>{arg-key-2}</arg_key><arg_value>{arg-value-2}</arg_value>...</tool_call>{%- endif -%}
|
| 17 |
+
{%- macro visible_text(content) -%}
|
| 18 |
+
{%- if content is string -%}
|
| 19 |
+
{{- content }}
|
| 20 |
+
{%- elif content is iterable and content is not mapping -%}
|
| 21 |
+
{%- for item in content -%}
|
| 22 |
+
{%- if item is mapping and item.type == 'text' -%}
|
| 23 |
+
{{- item.text }}
|
| 24 |
+
{%- elif item is string -%}
|
| 25 |
+
{{- item }}
|
| 26 |
+
{%- endif -%}
|
| 27 |
+
{%- endfor -%}
|
| 28 |
+
{%- else -%}
|
| 29 |
+
{{- content }}
|
| 30 |
+
{%- endif -%}
|
| 31 |
+
{%- endmacro -%}
|
| 32 |
+
{%- set ns = namespace(last_user_index=-1) %}
|
| 33 |
+
{%- for m in messages %}
|
| 34 |
+
{%- if m.role == 'user' %}
|
| 35 |
+
{% set ns.last_user_index = loop.index0 -%}
|
| 36 |
+
{%- endif %}
|
| 37 |
+
{%- endfor %}
|
| 38 |
+
{% for m in messages %}
|
| 39 |
+
{%- if m.role == 'user' -%}<|user|>{{ visible_text(m.content) }}
|
| 40 |
+
{%- elif m.role == 'assistant' -%}
|
| 41 |
+
<|assistant|>
|
| 42 |
+
{%- set reasoning_content = '' %}
|
| 43 |
+
{%- set content = visible_text(m.content) %}
|
| 44 |
+
{%- if m.reasoning_content is string %}
|
| 45 |
+
{%- set reasoning_content = m.reasoning_content %}
|
| 46 |
+
{%- else %}
|
| 47 |
+
{%- if '</think>' in content %}
|
| 48 |
+
{%- set reasoning_content = content.split('</think>')[0].rstrip('\n').split('<think>')[-1].lstrip('\n') %}
|
| 49 |
+
{%- set content = content.split('</think>')[-1].lstrip('\n') %}
|
| 50 |
+
{%- endif %}
|
| 51 |
+
{%- endif %}
|
| 52 |
+
{%- if ((clear_thinking is defined and not clear_thinking) or loop.index0 > ns.last_user_index) and reasoning_content -%}
|
| 53 |
+
{{ '<think>' + reasoning_content.strip() + '</think>'}}
|
| 54 |
+
{%- else -%}
|
| 55 |
+
{{ '</think>' }}
|
| 56 |
+
{%- endif -%}
|
| 57 |
+
{%- if content.strip() -%}
|
| 58 |
+
{{ content.strip() }}
|
| 59 |
+
{%- endif -%}
|
| 60 |
+
{% if m.tool_calls %}
|
| 61 |
+
{% for tc in m.tool_calls %}
|
| 62 |
+
{%- if tc.function %}
|
| 63 |
+
{%- set tc = tc.function %}
|
| 64 |
+
{%- endif %}
|
| 65 |
+
{{- '<tool_call>' + tc.name -}}
|
| 66 |
+
{% set _args = tc.arguments %}{% for k, v in _args.items() %}<arg_key>{{ k }}</arg_key><arg_value>{{ v | tojson(ensure_ascii=False) if v is not string else v }}</arg_value>{% endfor %}</tool_call>{% endfor %}
|
| 67 |
+
{% endif %}
|
| 68 |
+
{%- elif m.role == 'tool' -%}
|
| 69 |
+
{%- if m.content is string -%}
|
| 70 |
+
{%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
|
| 71 |
+
{{- '<|observation|>' }}
|
| 72 |
+
{%- endif %}
|
| 73 |
+
{{- '<tool_response>' }}
|
| 74 |
+
{{- m.content }}
|
| 75 |
+
{{- '</tool_response>' }}
|
| 76 |
+
{%- else -%}
|
| 77 |
+
<|observation|>{% for tr in m.content %}
|
| 78 |
+
<tool_response>{{ tr.output if tr.output is defined else tr }}</tool_response>{% endfor -%}
|
| 79 |
+
{% endif -%}
|
| 80 |
+
{%- elif m.role == 'system' -%}
|
| 81 |
+
<|system|>{{ visible_text(m.content) }}
|
| 82 |
+
{%- endif -%}
|
| 83 |
+
{%- endfor -%}
|
| 84 |
+
{%- if add_generation_prompt -%}
|
| 85 |
+
<|assistant|>{{- '</think>' if (enable_thinking is defined and not enable_thinking) else '<think>' -}}
|
| 86 |
+
{%- endif -%}
|
config.json
ADDED
|
@@ -0,0 +1,53 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"architectures": [
|
| 3 |
+
"Glm4MoeForCausalLM"
|
| 4 |
+
],
|
| 5 |
+
"attention_bias": true,
|
| 6 |
+
"attention_dropout": 0.0,
|
| 7 |
+
"dtype": "bfloat16",
|
| 8 |
+
"eos_token_id": [
|
| 9 |
+
151329,
|
| 10 |
+
151336,
|
| 11 |
+
151338
|
| 12 |
+
],
|
| 13 |
+
"first_k_dense_replace": 3,
|
| 14 |
+
"head_dim": 128,
|
| 15 |
+
"hidden_act": "silu",
|
| 16 |
+
"hidden_size": 5120,
|
| 17 |
+
"initializer_range": 0.02,
|
| 18 |
+
"intermediate_size": 12288,
|
| 19 |
+
"max_position_embeddings": 202752,
|
| 20 |
+
"model_type": "glm4_moe",
|
| 21 |
+
"moe_intermediate_size": 1536,
|
| 22 |
+
"n_group": 1,
|
| 23 |
+
"n_routed_experts": 160,
|
| 24 |
+
"n_shared_experts": 1,
|
| 25 |
+
"norm_topk_prob": true,
|
| 26 |
+
"num_attention_heads": 96,
|
| 27 |
+
"num_experts_per_tok": 8,
|
| 28 |
+
"num_hidden_layers": 92,
|
| 29 |
+
"num_key_value_heads": 8,
|
| 30 |
+
"num_nextn_predict_layers": 0,
|
| 31 |
+
"pad_token_id": 151329,
|
| 32 |
+
"partial_rotary_factor": 0.5,
|
| 33 |
+
"quantization": {
|
| 34 |
+
"group_size": 64,
|
| 35 |
+
"bits": 6,
|
| 36 |
+
"mode": "affine"
|
| 37 |
+
},
|
| 38 |
+
"quantization_config": {
|
| 39 |
+
"group_size": 64,
|
| 40 |
+
"bits": 6,
|
| 41 |
+
"mode": "affine"
|
| 42 |
+
},
|
| 43 |
+
"rms_norm_eps": 1e-05,
|
| 44 |
+
"rope_scaling": null,
|
| 45 |
+
"rope_theta": 1000000,
|
| 46 |
+
"routed_scaling_factor": 2.5,
|
| 47 |
+
"tie_word_embeddings": false,
|
| 48 |
+
"topk_group": 1,
|
| 49 |
+
"transformers_version": "4.57.3",
|
| 50 |
+
"use_cache": true,
|
| 51 |
+
"use_qk_norm": true,
|
| 52 |
+
"vocab_size": 151552
|
| 53 |
+
}
|
generation_config.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"_from_model_config": true,
|
| 3 |
+
"eos_token_id": [
|
| 4 |
+
151329,
|
| 5 |
+
151336,
|
| 6 |
+
151338
|
| 7 |
+
],
|
| 8 |
+
"pad_token_id": 151329,
|
| 9 |
+
"transformers_version": "4.57.3"
|
| 10 |
+
}
|
model-00001-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ba03c8a696633fd4b15610301ca83f214f930342b5fbd843e58bdc1799588417
|
| 3 |
+
size 4732435585
|
model-00002-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9e9c2fa6c5d257126a37383a064377a0e1f57f7305e591fd57e629ec083d4b01
|
| 3 |
+
size 5243427265
|
model-00003-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:43b8877c40d1096ba08ea5005f1f0231513e4a563ff1f2609bd5763a0e93b2df
|
| 3 |
+
size 5335722898
|
model-00004-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1371cd56d328eff13f2707f972d1df54f5f7e2ec885512084e39c3710e5c10ca
|
| 3 |
+
size 5363247106
|
model-00005-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:072382f332932e469187b15d5936d4bd766ffb0181e333a71c663d3e4628c534
|
| 3 |
+
size 5294546458
|
model-00006-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:301065e97eb8d631a71efaac807d57170c8e17dfd93a222a31be676ea7c6ffc5
|
| 3 |
+
size 5335722946
|
model-00007-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bc0a5b9b68b89ae04f25d6536be60d67aaf4e7379b969154bf5e31d4910910a5
|
| 3 |
+
size 5363247185
|
model-00008-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fa362e004a657ffb5ab58289299164b4300e9cc69d0aaf5a2033930279b9b008
|
| 3 |
+
size 5294546451
|
model-00009-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:06844ca57df6c056a5b9eb2a50baff4ae4aebe47209c69a102b53a2cf811040f
|
| 3 |
+
size 5335722966
|
model-00010-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:007317079e2fd9949408d7fbc04dfdba69622cd7a6d49484eb3090e6fe191979
|
| 3 |
+
size 5363247163
|
model-00011-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5007f6ea7b13c3a34b2791bb0e35f5a13875c2524b3af0d31b56aa0fe6ffc2a8
|
| 3 |
+
size 5294546461
|
model-00012-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fdd3ae73a6a34a1bceec05db962eb0c9a75a30503df5b7af75586d779fb0f062
|
| 3 |
+
size 5335722940
|
model-00013-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5a0c748e94eb5795265efedf132fe9bb89ed3ed5f7bb4e0fc2a405e817c2f6b1
|
| 3 |
+
size 5363247197
|
model-00014-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1c2a43ba7d7d889755899949a2c8ffe7ede719ca1d51d400ade6bed6f0394720
|
| 3 |
+
size 5294546487
|
model-00015-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0eec7c372c489c3bc74d96ffd444fc671680b4b8e4997d0dd4fd1ded0dbc3a58
|
| 3 |
+
size 5335722976
|
model-00016-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:988921c93f8bf5c93748db558e2fdf4e9d50d9d7a06fd0cb8768c48c27c73ac5
|
| 3 |
+
size 5363247143
|
model-00017-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2c7f6d115633658f7079bf13ad4ae7ea2c297c9af990b87ff61136ff9f7189c5
|
| 3 |
+
size 5294546487
|
model-00018-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:626461cdc99102326bc652beec02b9c98b096dc514a915d9114f475eeca6b7c7
|
| 3 |
+
size 5335722962
|
model-00019-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0698449f1212f8aa85e9652b5cf1e3937f57213ec16894a771d4a3ffecbc866a
|
| 3 |
+
size 5363247181
|
model-00020-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c19a9603d53bbe923224ed0f449be3d8885c1541426c59e2e44b08af25b3c0cb
|
| 3 |
+
size 5294546489
|
model-00021-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:153754f5f9166d3c60531b9f7171c00b7632e319e9dcaef6a317273831b69d8c
|
| 3 |
+
size 5335722984
|
model-00023-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:17bee436570b426c7ea2cb49737837759e1c09206a7f0d290be5ef3253b49494
|
| 3 |
+
size 5294546481
|
model-00024-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e387da82f550c85299a3c0c88ed06dbbc91a929f1dce991e4fc0035ea0695e46
|
| 3 |
+
size 5335722908
|
model-00026-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cdff223a82658b5544e063aeb91ec2d857e725e16179c04841c133ada833676d
|
| 3 |
+
size 5294546487
|
model-00029-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c771d3a763e3a1b3ba294179a8cba8df7f457e1cc63fc63a00f7b86a341521d0
|
| 3 |
+
size 5294546487
|
model-00037-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:75c255aa91124eee1e192b5d31d789a031388d9dd125290f7c5af9c198874611
|
| 3 |
+
size 5363247177
|
model-00039-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1b15b0aed51b6367be653dfcd109d60e7227372cb9e9ce580626523939d7d4a1
|
| 3 |
+
size 5335722982
|
model-00040-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:90c937c7987b82cc1dd2ba6f8cc37801affb3bcdcfbcc6e4a56bddcd862735b0
|
| 3 |
+
size 5363247177
|
model-00041-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:62aecc560041dfdfc3c06c9d5ff07cdb1fe5ab220921f4349038e07c78d0211e
|
| 3 |
+
size 5294546479
|
model-00042-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:77ecdc56c9cde9f0985640d09dbe9507542ac6df3dd31ccbab66f8b02b19b3cb
|
| 3 |
+
size 5335722966
|
model-00043-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0eb7269a795cf6e87132c7ea54022c9d6909d8efbec050bafa37b99d77f3d1e7
|
| 3 |
+
size 5363247181
|
model-00044-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dec8372b5baa4f4bce9fa268386e2bfe794c5184d9e6af9c0327d59f1b92f97f
|
| 3 |
+
size 5294546447
|
model-00045-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:662e54b6b82fed986c215b8d4fb1dc7751941d4d00f8a68c71cf500ab966ee3a
|
| 3 |
+
size 5335722978
|
model-00046-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1da5fb1257fcb73dd8be77a8f7e01484cbf5f4ef93ed5cdb55fc8a16a8a6dfb7
|
| 3 |
+
size 5363247189
|
model-00047-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:735a7b36c85a542d3c7b435beecff5a0dc1f869a5273e326dcbe1b4143e96edc
|
| 3 |
+
size 5294546487
|
model-00048-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e75d8f1b1cad7a097daeb66872c4174db1f059c9d0da9cc009c78c091e4207b5
|
| 3 |
+
size 5335722980
|
model-00049-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7a8c6bc3099faf9d5bd97c73c7462536950adebba6592b64069d36758f070908
|
| 3 |
+
size 5363247191
|
model-00050-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:329ecda84031f10efa9c8e4945cfb820bb0e27f6b8013cb3f64da148aa5f9308
|
| 3 |
+
size 5294546489
|
model-00051-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ab133165375e95fd47fb6ca30bceba894e4ebfdf1d46ffd47eb656fdd2a6c4ff
|
| 3 |
+
size 5335722964
|
model-00052-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1c340b8b5cf0b78e15dbdf2fa4697857a55c9a660d50d5d8b8d713c577786c4b
|
| 3 |
+
size 5363247191
|
model-00053-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:89019491f82279e8c39d09db2cb00463aae5665b5b461fb5ca24825eaa8cdb30
|
| 3 |
+
size 5294546487
|
model-00054-of-00054.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:57d9c7b497558f341a58d5363e30f1c21c62124c5cfb95d1c10ef2ffba0451ad
|
| 3 |
+
size 4872362644
|
model.safetensors.index.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
tokenizer.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f0ccf2252fe9cd23ada23a829ec409aab397dbd2ac4f372d3a1a23d1f7c72d6b
|
| 3 |
+
size 19970686
|