tperes commited on
Commit
9356d4d
·
verified ·
1 Parent(s): 9a92bf9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +28 -6
README.md CHANGED
@@ -16,13 +16,13 @@ language:
16
 
17
  # Model Card: palmyra-mini-thinking-b
18
 
19
- ## Model Details
20
 
21
- **Model Name:** palmyra-mini-thinking-b
22
-
23
- **Version:** 1.0
24
-
25
- **Type:** Generative AI Language Model
26
 
27
  ## Introduction
28
 
@@ -110,6 +110,28 @@ output_text = tokenizer.decode(output_id[0][input_ids.shape[1] :])
110
  print(output_text)
111
  ```
112
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
113
  ## Ethical Considerations
114
 
115
  As with any language model, there is a potential for generating biased or inaccurate information. Users should be aware of these limitations and use the model responsibly.
 
16
 
17
  # Model Card: palmyra-mini-thinking-b
18
 
19
+ ### Model Description
20
 
21
+ - **Language(s) (NLP):** English
22
+ - **License:** Apache-2.0
23
+ - **Finetuned from model:** Qwen/Qwen2.5-1.5B
24
+ - **Context window:** 131,072 tokens
25
+ - **Parameters:** 1.7 billion
26
 
27
  ## Introduction
28
 
 
110
  print(output_text)
111
  ```
112
 
113
+ ## curl Instructions
114
+ ```py
115
+ curl -X POST http://localhost:8000/v1/chat/completions \
116
+ -H "Content-Type: application/json" \
117
+ -d '{
118
+ "model": "Writer/palmyra-mini-thinking-b",
119
+ "messages": [
120
+ {
121
+ "role": "user",
122
+ "content": "You have a 3-liter jug and a 5-liter jug. How can you measure exactly 4 liters of water?"
123
+ }
124
+ ],
125
+ "max_tokens": 8000,
126
+ "temperature": 0.2
127
+ }'
128
+ ```
129
+
130
+ ## VLLM Inference
131
+ ```py
132
+ vllm serve Writer/palmyra-mini-thinking-b
133
+ ```
134
+
135
  ## Ethical Considerations
136
 
137
  As with any language model, there is a potential for generating biased or inaccurate information. Users should be aware of these limitations and use the model responsibly.