Update README.md
Browse files
README.md
CHANGED
|
@@ -110,7 +110,10 @@ output_text = tokenizer.decode(output_id[0][input_ids.shape[1] :])
|
|
| 110 |
print(output_text)
|
| 111 |
```
|
| 112 |
|
| 113 |
-
##
|
|
|
|
|
|
|
|
|
|
| 114 |
```py
|
| 115 |
curl -X POST http://localhost:8000/v1/chat/completions \
|
| 116 |
-H "Content-Type: application/json" \
|
|
@@ -127,11 +130,6 @@ curl -X POST http://localhost:8000/v1/chat/completions \
|
|
| 127 |
}'
|
| 128 |
```
|
| 129 |
|
| 130 |
-
## VLLM Inference
|
| 131 |
-
```py
|
| 132 |
-
vllm serve Writer/palmyra-mini-thinking-b
|
| 133 |
-
```
|
| 134 |
-
|
| 135 |
## Ethical Considerations
|
| 136 |
|
| 137 |
As with any language model, there is a potential for generating biased or inaccurate information. Users should be aware of these limitations and use the model responsibly.
|
|
@@ -146,8 +144,8 @@ To cite this model:
|
|
| 146 |
author = {Writer Engineering team},
|
| 147 |
title = {{Palmyra-mini: A powerful LLM designed for math and coding}},
|
| 148 |
howpublished = {\url{https://dev.writer.com}},
|
| 149 |
-
year =
|
| 150 |
-
month =
|
| 151 |
}
|
| 152 |
```
|
| 153 |
Contact Hello@writer.com
|
|
|
|
| 110 |
print(output_text)
|
| 111 |
```
|
| 112 |
|
| 113 |
+
## Running with vLLM
|
| 114 |
+
```py
|
| 115 |
+
vllm serve Writer/palmyra-mini-thinking-b
|
| 116 |
+
```
|
| 117 |
```py
|
| 118 |
curl -X POST http://localhost:8000/v1/chat/completions \
|
| 119 |
-H "Content-Type: application/json" \
|
|
|
|
| 130 |
}'
|
| 131 |
```
|
| 132 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 133 |
## Ethical Considerations
|
| 134 |
|
| 135 |
As with any language model, there is a potential for generating biased or inaccurate information. Users should be aware of these limitations and use the model responsibly.
|
|
|
|
| 144 |
author = {Writer Engineering team},
|
| 145 |
title = {{Palmyra-mini: A powerful LLM designed for math and coding}},
|
| 146 |
howpublished = {\url{https://dev.writer.com}},
|
| 147 |
+
year = 2025,
|
| 148 |
+
month = Sep
|
| 149 |
}
|
| 150 |
```
|
| 151 |
Contact Hello@writer.com
|