Instructions to use brkichle/lora-llama3-archimate with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use brkichle/lora-llama3-archimate with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="brkichle/lora-llama3-archimate")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("brkichle/lora-llama3-archimate", device_map="auto")

PEFT
How to use brkichle/lora-llama3-archimate with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use brkichle/lora-llama3-archimate with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "brkichle/lora-llama3-archimate"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "brkichle/lora-llama3-archimate",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/brkichle/lora-llama3-archimate

SGLang

How to use brkichle/lora-llama3-archimate with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "brkichle/lora-llama3-archimate" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "brkichle/lora-llama3-archimate",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "brkichle/lora-llama3-archimate" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "brkichle/lora-llama3-archimate",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use brkichle/lora-llama3-archimate with Docker Model Runner:
```
docker model run hf.co/brkichle/lora-llama3-archimate
```

lora-llama3-archimate

Commit History

Add metrics for run-ad641185

1938a9d
verified

brkichle commited on Jun 6, 2025

Upload eval_results.json with huggingface_hub

c95393d
verified

brkichle commited on Jun 6, 2025

Upload folder using huggingface_hub

384d7e3
verified

brkichle commited on Jun 6, 2025

Upload eval_results.json with huggingface_hub

a99b061
verified

brkichle commited on Jun 6, 2025

Upload folder using huggingface_hub

2537670
verified

brkichle commited on Jun 6, 2025

Update README.md

e3e9c73
verified

brkichle commited on Jun 6, 2025

Update README.md

367baac
verified

brkichle commited on Jun 6, 2025

Updating metadata from 2025-06-05 run

d06039f
verified

brkichle commited on Jun 6, 2025

Upload eval_results.json with huggingface_hub

4d21ab4
verified

brkichle commited on Jun 5, 2025

Upload folder using huggingface_hub

55c2faf
verified

brkichle commited on Jun 5, 2025

Upload eval_results.json with huggingface_hub

d953858
verified

brkichle commited on Jun 5, 2025

Upload folder using huggingface_hub

9bd6bca
verified

brkichle commited on Jun 5, 2025

Upload eval_results.json with huggingface_hub

41a8348
verified

brkichle commited on Jun 4, 2025

Upload folder using huggingface_hub

9a83dd5
verified

brkichle commited on Jun 4, 2025

Upload eval_results.json with huggingface_hub

21bdabe
verified

brkichle commited on Jun 4, 2025

Upload folder using huggingface_hub

4ed6ae7
verified

brkichle commited on Jun 4, 2025

Upload eval_results.json with huggingface_hub

7884613
verified

brkichle commited on Jun 3, 2025