tperes commited on
Commit
f519b3f
·
verified ·
1 Parent(s): 9356d4d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -8
README.md CHANGED
@@ -110,7 +110,10 @@ output_text = tokenizer.decode(output_id[0][input_ids.shape[1] :])
110
  print(output_text)
111
  ```
112
 
113
- ## curl Instructions
 
 
 
114
  ```py
115
  curl -X POST http://localhost:8000/v1/chat/completions \
116
  -H "Content-Type: application/json" \
@@ -127,11 +130,6 @@ curl -X POST http://localhost:8000/v1/chat/completions \
127
  }'
128
  ```
129
 
130
- ## VLLM Inference
131
- ```py
132
- vllm serve Writer/palmyra-mini-thinking-b
133
- ```
134
-
135
  ## Ethical Considerations
136
 
137
  As with any language model, there is a potential for generating biased or inaccurate information. Users should be aware of these limitations and use the model responsibly.
@@ -146,8 +144,8 @@ To cite this model:
146
  author = {Writer Engineering team},
147
  title = {{Palmyra-mini: A powerful LLM designed for math and coding}},
148
  howpublished = {\url{https://dev.writer.com}},
149
- year = 2024,
150
- month = Oct
151
  }
152
  ```
153
  Contact Hello@writer.com
 
110
  print(output_text)
111
  ```
112
 
113
+ ## Running with vLLM
114
+ ```py
115
+ vllm serve Writer/palmyra-mini-thinking-b
116
+ ```
117
  ```py
118
  curl -X POST http://localhost:8000/v1/chat/completions \
119
  -H "Content-Type: application/json" \
 
130
  }'
131
  ```
132
 
 
 
 
 
 
133
  ## Ethical Considerations
134
 
135
  As with any language model, there is a potential for generating biased or inaccurate information. Users should be aware of these limitations and use the model responsibly.
 
144
  author = {Writer Engineering team},
145
  title = {{Palmyra-mini: A powerful LLM designed for math and coding}},
146
  howpublished = {\url{https://dev.writer.com}},
147
+ year = 2025,
148
+ month = Sep
149
  }
150
  ```
151
  Contact Hello@writer.com