| --- |
| license: apache-2.0 |
| --- |
| |
| Quantization of [mzbac/llama-3-8B-Instruct-function-calling-v0.2](https://huggingface.co/mzbac/llama-3-8B-Instruct-function-calling-v0.2) info GGUF |
|
|
| # Llama 3 function calling |
|
|
| Tested within LM Studio. |
|
|
|
|
| ## Request |
| ```bash |
| curl --location 'http://localhost:5000/v1/chat/completions' \ |
| --header 'Content-Type: application/json' \ |
| --data '{ |
| "model": "AABAAB/llama-3-8B-Instruct-function-calling-v0.2/llama-3-8B-Instruct-function-calling-v0.2_Q8_0.gguf", |
| "messages": [ |
| { |
| "role": "system", |
| "content": "You are a helpful assistant with access to the following functions. Use them if required - {\"name\": \"search_web\",\"description\": \"Perform a web search for a given search terms.\",\"parameter\": {\"type\": \"object\", \"properties\": {\"search_terms\": {\"type\": \"array\",\"items\": {\"type\": \"string\"},\"description\": \"The search queries for which the search is performed.\",\"required\": True,}}},}" |
| }, |
| { |
| "role": "user", |
| "content": "What is the weather in Sydney?" |
| } |
| ], |
| "stream": false |
| }' |
| ``` |
|
|
| ## Response |
|
|
| ``` |
| <functioncall> {\"name\": \"search_web\", \"arguments\": {\"search_terms\": [\"weather in Sydney\"]}} |
| ``` |
|
|
|  |
|
|
|
|
