Instructions to use Raiff1982/CodetteFineTuned with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Raiff1982/CodetteFineTuned with PEFT:

from peft import PeftModel
from transformers import AutoModelForCausalLM

base_model = AutoModelForCausalLM.from_pretrained("gpt2")
model = PeftModel.from_pretrained(base_model, "Raiff1982/CodetteFineTuned")

Transformers

How to use Raiff1982/CodetteFineTuned with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Raiff1982/CodetteFineTuned")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("Raiff1982/CodetteFineTuned", dtype="auto")

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use Raiff1982/CodetteFineTuned with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Raiff1982/CodetteFineTuned"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Raiff1982/CodetteFineTuned",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/Raiff1982/CodetteFineTuned

SGLang

How to use Raiff1982/CodetteFineTuned with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Raiff1982/CodetteFineTuned" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Raiff1982/CodetteFineTuned",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Raiff1982/CodetteFineTuned" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Raiff1982/CodetteFineTuned",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use Raiff1982/CodetteFineTuned with Docker Model Runner:
```
docker model run hf.co/Raiff1982/CodetteFineTuned
```

Raiff1982 commited on Dec 22, 2025

Commit

807bab9

verified ·

1 Parent(s): 492e583

Add 6 files

Browse files

Files changed (5) hide show

adapter_model.safetensors +3 -0
images/Codette_Quantum_Harmonic_Framework.png +3 -0
optimizer.pt +3 -0
scheduler.pt +3 -0
training_args.bin +3 -0

adapter_model.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e3c8cdf55c40e1ce4aabb0860bb20e446193984a5ce465c50a9e870a268df6e8
+size 1182680

images/Codette_Quantum_Harmonic_Framework.png ADDED Viewed

Git LFS Details

SHA256: a950a3cbee0e4e750bcb556f7169530562870fe9d173045dbd74a0ccb4649ebe
Pointer size: 131 Bytes
Size of remote file: 190 kB

optimizer.pt ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:17a48af1e88bcfd562b94e58540bbbe1978ab8f5dba717e76847f0f411a32e7f
+size 2379751

scheduler.pt ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8bfd4cc170e7761fb15f6e7ad9e3aa72285502fc2314dfaeb5c670a6e7493ba8
+size 1465

training_args.bin ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a2fc735d44ff29ae5bfd0ab3fba3554b122be5fd781e26d845e2aad2d6eff5b6
+size 5777