Instructions to use goppa-ai/Goppa-LogiLlama with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use goppa-ai/Goppa-LogiLlama with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="goppa-ai/Goppa-LogiLlama")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("goppa-ai/Goppa-LogiLlama")
model = AutoModelForCausalLM.from_pretrained("goppa-ai/Goppa-LogiLlama")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use goppa-ai/Goppa-LogiLlama with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "goppa-ai/Goppa-LogiLlama"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "goppa-ai/Goppa-LogiLlama",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/goppa-ai/Goppa-LogiLlama

SGLang

How to use goppa-ai/Goppa-LogiLlama with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "goppa-ai/Goppa-LogiLlama" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "goppa-ai/Goppa-LogiLlama",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "goppa-ai/Goppa-LogiLlama" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "goppa-ai/Goppa-LogiLlama",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use goppa-ai/Goppa-LogiLlama with Docker Model Runner:
```
docker model run hf.co/goppa-ai/Goppa-LogiLlama
```

Goppa-LogiLlama

Commit History

Update README.md

a08404c
verified

Maria Alasam commited on Mar 6, 2025

Update README.md

12de5b8
verified

Maria Alasam commited on Mar 6, 2025

Update README.md

df5c4aa
verified

Maria Alasam commited on Mar 6, 2025

Update README.md

2f49fcd
verified

Maria Alasam commited on Mar 6, 2025

Update README.md

3203b11
verified

Maria Alasam commited on Mar 6, 2025

Update README.md

82d9fe3
verified

Maria Alasam commited on Mar 6, 2025

Update README.md

d4f8b5e
verified

Maria Alasam commited on Mar 6, 2025

Update README.md

fd07231
verified

Maria Alasam commited on Mar 6, 2025

Upload 6 files

6b60a68
verified

Maria Alasam commited on Mar 6, 2025

Update README.md

217f444
verified

Maria Alasam commited on Mar 6, 2025

Update README.md

4e67133
verified

Maria Alasam commited on Mar 6, 2025

initial commit

7839087
verified

Maria Alasam commited on Mar 6, 2025

Commit History

Update README.md a08404c verified

Update README.md 12de5b8 verified

Update README.md df5c4aa verified

Update README.md 2f49fcd verified

Update README.md 3203b11 verified

Update README.md 82d9fe3 verified

Update README.md d4f8b5e verified

Update README.md fd07231 verified

Upload 6 files 6b60a68 verified

Update README.md 217f444 verified

Update README.md 4e67133 verified

initial commit 7839087 verified

Update README.md

a08404c
verified

Update README.md

12de5b8
verified

Update README.md

df5c4aa
verified

Update README.md

2f49fcd
verified

Update README.md

3203b11
verified

Update README.md

82d9fe3
verified

Update README.md

d4f8b5e
verified

Update README.md

fd07231
verified

Upload 6 files

6b60a68
verified

Update README.md

217f444
verified

Update README.md

4e67133
verified

initial commit

7839087
verified