Update README.md
Browse files
README.md
CHANGED
|
@@ -127,15 +127,13 @@ The server provides a ChatGPT-compatible API with the following main endpoints:
|
|
| 127 |
|
| 128 |
- The server uses the same API format as OpenAI's ChatGPT API, making it compatible with many existing tools and libraries
|
| 129 |
- The `--jinja` flag enables proper chat template formatting for the model, which is essential for tool usage
|
| 130 |
-
- The model name in the requests can be set to "any-model" as shown in the examples
|
| 131 |
-
- This version supports system messages with tool definitions
|
| 132 |
|
| 133 |
## Troubleshooting
|
| 134 |
|
| 135 |
If you encounter issues:
|
| 136 |
|
| 137 |
1. Ensure the model file exists in the specified path
|
| 138 |
-
2. Check that port
|
| 139 |
3. Verify that llama-cpp-python is installed with server support
|
| 140 |
|
| 141 |
## License
|
|
|
|
| 127 |
|
| 128 |
- The server uses the same API format as OpenAI's ChatGPT API, making it compatible with many existing tools and libraries
|
| 129 |
- The `--jinja` flag enables proper chat template formatting for the model, which is essential for tool usage
|
|
|
|
|
|
|
| 130 |
|
| 131 |
## Troubleshooting
|
| 132 |
|
| 133 |
If you encounter issues:
|
| 134 |
|
| 135 |
1. Ensure the model file exists in the specified path
|
| 136 |
+
2. Check that port 8080 is not in use by another application
|
| 137 |
3. Verify that llama-cpp-python is installed with server support
|
| 138 |
|
| 139 |
## License
|