tinginsight's picture
Update README.md
3696c57 verified
---
language:
- en
base_model:
- meta-llama/Llama-3.1-8B-Instruct
tags:
- computer
- IToperation
- WindowsErrorCode
datasets:
- insightfinderai/windows_error_code_qa
---
# Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->
This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).
## Model Details
### Model Description
<!-- Provide a longer summary of what this model is. -->
- **Developed by:** InsightFinder AI
- **Funded by [optional]:** InsightFinder AI
- **Shared by [optional]:** InsightFinder AI
- **Model type:** Instruct Model
- **Language(s) (NLP):** Q/A
- **License:** [More Information Needed]
- **Finetuned from model [optional]:** meta-llama/Llama-3.1-8B-Instruct
## How to Get Started with the Model
Use the code below to get started with the model.
1. start `vllm` with the following command
```
--model meta-llama/Meta-Llama-3.1-8B-Instruct
--enable-lora
--lora-modules mylora=/lora_adapter
```
2. Once the model is up, prompt the model use the following example cmd
```
curl http://localhost:18000/v1/chat/completions -H "Content-Type: application/json" -d '{
"model": "mylora",
"messages": [
{"role": "user", "content": "What is Windows error code 0xd6?"}
],
"temperature": 0.7
}'
```
The correct response will contain something like `Error code 0xd6 indicates DRIVER_PAGE_FAULT_BEYOND_END_OF_ALLOCATION....`
## Model Card Contact
InsightFinder AI