tperes commited on
Commit
6883aa8
·
verified ·
1 Parent(s): 37c42d8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +28 -6
README.md CHANGED
@@ -15,13 +15,13 @@ language:
15
 
16
  # Model: palmyra-mini-thinking-a
17
 
18
- ## Model Details
19
 
20
- **Model Name:** palmyra-mini-thinking-a
21
-
22
- **Version:** 1.0
23
-
24
- **Type:** Generative AI Language Model
25
 
26
 
27
  ## Model Description
@@ -106,6 +106,28 @@ output_text = tokenizer.decode(output_id[0][input_ids.shape[1] :])
106
  print(output_text)
107
  ```
108
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
109
 
110
  ## Ethical Considerations
111
 
 
15
 
16
  # Model: palmyra-mini-thinking-a
17
 
18
+ ### Model Description
19
 
20
+ - **Language(s) (NLP):** English
21
+ - **License:** Apache-2.0
22
+ - **Finetuned from model:** Qwen/Qwen2.5-1.5B
23
+ - **Context window:** 131,072 tokens
24
+ - **Parameters:** 1.7 billion
25
 
26
 
27
  ## Model Description
 
106
  print(output_text)
107
  ```
108
 
109
+ ## curl Instructions
110
+ ```py
111
+ curl -X POST http://localhost:8000/v1/chat/completions \
112
+ -H "Content-Type: application/json" \
113
+ -d '{
114
+ "model": "Writer/palmyra-mini-thinking-a",
115
+ "messages": [
116
+ {
117
+ "role": "user",
118
+ "content": "You have a 3-liter jug and a 5-liter jug. How can you measure exactly 4 liters of water?"
119
+ }
120
+ ],
121
+ "max_tokens": 8000,
122
+ "temperature": 0.2
123
+ }'
124
+ ```
125
+
126
+ ## VLLM Inference
127
+ ```py
128
+ vllm serve Writer/palmyra-mini-thinking-a
129
+ ```
130
+
131
 
132
  ## Ethical Considerations
133