Update README.md
Browse files
README.md
CHANGED
|
@@ -15,13 +15,13 @@ language:
|
|
| 15 |
|
| 16 |
# Model: palmyra-mini-thinking-a
|
| 17 |
|
| 18 |
-
## Model
|
| 19 |
|
| 20 |
-
**
|
| 21 |
-
|
| 22 |
-
**
|
| 23 |
-
|
| 24 |
-
**
|
| 25 |
|
| 26 |
|
| 27 |
## Model Description
|
|
@@ -106,6 +106,28 @@ output_text = tokenizer.decode(output_id[0][input_ids.shape[1] :])
|
|
| 106 |
print(output_text)
|
| 107 |
```
|
| 108 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 109 |
|
| 110 |
## Ethical Considerations
|
| 111 |
|
|
|
|
| 15 |
|
| 16 |
# Model: palmyra-mini-thinking-a
|
| 17 |
|
| 18 |
+
### Model Description
|
| 19 |
|
| 20 |
+
- **Language(s) (NLP):** English
|
| 21 |
+
- **License:** Apache-2.0
|
| 22 |
+
- **Finetuned from model:** Qwen/Qwen2.5-1.5B
|
| 23 |
+
- **Context window:** 131,072 tokens
|
| 24 |
+
- **Parameters:** 1.7 billion
|
| 25 |
|
| 26 |
|
| 27 |
## Model Description
|
|
|
|
| 106 |
print(output_text)
|
| 107 |
```
|
| 108 |
|
| 109 |
+
## curl Instructions
|
| 110 |
+
```py
|
| 111 |
+
curl -X POST http://localhost:8000/v1/chat/completions \
|
| 112 |
+
-H "Content-Type: application/json" \
|
| 113 |
+
-d '{
|
| 114 |
+
"model": "Writer/palmyra-mini-thinking-a",
|
| 115 |
+
"messages": [
|
| 116 |
+
{
|
| 117 |
+
"role": "user",
|
| 118 |
+
"content": "You have a 3-liter jug and a 5-liter jug. How can you measure exactly 4 liters of water?"
|
| 119 |
+
}
|
| 120 |
+
],
|
| 121 |
+
"max_tokens": 8000,
|
| 122 |
+
"temperature": 0.2
|
| 123 |
+
}'
|
| 124 |
+
```
|
| 125 |
+
|
| 126 |
+
## VLLM Inference
|
| 127 |
+
```py
|
| 128 |
+
vllm serve Writer/palmyra-mini-thinking-a
|
| 129 |
+
```
|
| 130 |
+
|
| 131 |
|
| 132 |
## Ethical Considerations
|
| 133 |
|