Update README.md
#9
by
AngelVenerov - opened
README.md
CHANGED
|
@@ -5,7 +5,7 @@ language:
|
|
| 5 |
- en
|
| 6 |
base_model:
|
| 7 |
- Qwen/Qwen2.5-Coder-32B
|
| 8 |
-
pipeline_tag:
|
| 9 |
library_name: transformers
|
| 10 |
tags:
|
| 11 |
- code
|
|
@@ -32,7 +32,7 @@ Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (
|
|
| 32 |
- Architecture: transformers with RoPE, SwiGLU, RMSNorm, and Attention QKV bias
|
| 33 |
- Number of Parameters: 32.5B
|
| 34 |
- Number of Paramaters (Non-Embedding): 31.0B
|
| 35 |
-
- Number of Layers:
|
| 36 |
- Number of Attention Heads (GQA): 40 for Q and 8 for KV
|
| 37 |
- Context Length: Full 131,072 tokens
|
| 38 |
- Please refer to [this section](#processing-long-texts) for detailed instructions on how to deploy Qwen2.5 for handling long texts.
|
|
@@ -78,7 +78,7 @@ model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
|
|
| 78 |
|
| 79 |
generated_ids = model.generate(
|
| 80 |
**model_inputs,
|
| 81 |
-
max_new_tokens=
|
| 82 |
)
|
| 83 |
generated_ids = [
|
| 84 |
output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
|
|
@@ -132,4 +132,4 @@ If you find our work helpful, feel free to give us a cite.
|
|
| 132 |
journal={arXiv preprint arXiv:2407.10671},
|
| 133 |
year={2024}
|
| 134 |
}
|
| 135 |
-
```
|
|
|
|
| 5 |
- en
|
| 6 |
base_model:
|
| 7 |
- Qwen/Qwen2.5-Coder-32B
|
| 8 |
+
pipeline_tag: image-to-text
|
| 9 |
library_name: transformers
|
| 10 |
tags:
|
| 11 |
- code
|
|
|
|
| 32 |
- Architecture: transformers with RoPE, SwiGLU, RMSNorm, and Attention QKV bias
|
| 33 |
- Number of Parameters: 32.5B
|
| 34 |
- Number of Paramaters (Non-Embedding): 31.0B
|
| 35 |
+
- Number of Layers: 512
|
| 36 |
- Number of Attention Heads (GQA): 40 for Q and 8 for KV
|
| 37 |
- Context Length: Full 131,072 tokens
|
| 38 |
- Please refer to [this section](#processing-long-texts) for detailed instructions on how to deploy Qwen2.5 for handling long texts.
|
|
|
|
| 78 |
|
| 79 |
generated_ids = model.generate(
|
| 80 |
**model_inputs,
|
| 81 |
+
max_new_tokens=4096
|
| 82 |
)
|
| 83 |
generated_ids = [
|
| 84 |
output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
|
|
|
|
| 132 |
journal={arXiv preprint arXiv:2407.10671},
|
| 133 |
year={2024}
|
| 134 |
}
|
| 135 |
+
```
|