Instructions to use ANLP-Final-Project/m0-oplora-lr with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use ANLP-Final-Project/m0-oplora-lr with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="ANLP-Final-Project/m0-oplora-lr")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("ANLP-Final-Project/m0-oplora-lr")
model = AutoModelForCausalLM.from_pretrained("ANLP-Final-Project/m0-oplora-lr")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use ANLP-Final-Project/m0-oplora-lr with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "ANLP-Final-Project/m0-oplora-lr"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ANLP-Final-Project/m0-oplora-lr",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/ANLP-Final-Project/m0-oplora-lr

SGLang

How to use ANLP-Final-Project/m0-oplora-lr with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "ANLP-Final-Project/m0-oplora-lr" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ANLP-Final-Project/m0-oplora-lr",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "ANLP-Final-Project/m0-oplora-lr" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ANLP-Final-Project/m0-oplora-lr",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use ANLP-Final-Project/m0-oplora-lr with Docker Model Runner:
```
docker model run hf.co/ANLP-Final-Project/m0-oplora-lr
```

sjudicke commited on Nov 13, 2025

Commit

e968f5c

verified ·

1 Parent(s): 70abb29

Training in progress, step 25000

Browse files

Files changed (6) hide show

model-00001-of-00006.safetensors +1 -1
model-00002-of-00006.safetensors +1 -1
model-00003-of-00006.safetensors +1 -1
model-00004-of-00006.safetensors +1 -1
model-00005-of-00006.safetensors +1 -1
model-00006-of-00006.safetensors +1 -1

model-00001-of-00006.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c60d5f8fd7f985f9dfe67164a777a63e9ad5a3c1f61885816f75e45f2b15347d
 size 4843561680

 version https://git-lfs.github.com/spec/v1
+oid sha256:4bf7d6e93ae043e435812c86aa9d713d619e3de5d7c9cd18a7905a714fa637aa
 size 4843561680

model-00002-of-00006.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ed6c15880a0bf2da32b4fa7c4623f4f52aad97d939b887c3e62fe38c0d642995
 size 4860355736

 version https://git-lfs.github.com/spec/v1
+oid sha256:b93f1e555d645231557dd6685fbf262b2fc7078aa639f44e609e0e96ef1bc145
 size 4860355736

model-00003-of-00006.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:35f07f3d078406fa302b3fdda789a017fd32c4fe9c4d14ef9da88d70e071fa7f
 size 4860355808

 version https://git-lfs.github.com/spec/v1
+oid sha256:c134882bd61471dc580640919f7993a58d19fc4328a0eafe3ba8f421dfd7e7f5
 size 4860355808

model-00004-of-00006.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c9df921bd34a39e0ca21fa5cc4c650dd2d67f2baf35aa7febe6a85f6bbff8e36
 size 4860355808

 version https://git-lfs.github.com/spec/v1
+oid sha256:aeecd14393610e52193494720e7f15f6fad668175e9e3aeff39c4bc3eda84c41
 size 4860355808

model-00005-of-00006.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d56dd0f56a7368bd71e4f33bfab7e7121ab22eaf79a0891cc8fe7124e7e7a7b1
 size 4860355808

 version https://git-lfs.github.com/spec/v1
+oid sha256:18b67ee897307dbcdfb474156973c7704543842401728beeb865fb270eed7907
 size 4860355808

model-00006-of-00006.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b68e208f65e0d17099755d8582fa4cc6d717c9d421894f8bea6159fd842f5c74
 size 2685538136

 version https://git-lfs.github.com/spec/v1
+oid sha256:95f43421659259c1d39afba6cabc7dfa079357b3aa56ca88dad728d54bde8b95
 size 2685538136