Instructions to use reasonrag/Qwen2.5-7B-Instruct-ReasonRAG with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use reasonrag/Qwen2.5-7B-Instruct-ReasonRAG with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="reasonrag/Qwen2.5-7B-Instruct-ReasonRAG")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("reasonrag/Qwen2.5-7B-Instruct-ReasonRAG")
model = AutoModelForCausalLM.from_pretrained("reasonrag/Qwen2.5-7B-Instruct-ReasonRAG")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use reasonrag/Qwen2.5-7B-Instruct-ReasonRAG with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "reasonrag/Qwen2.5-7B-Instruct-ReasonRAG"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "reasonrag/Qwen2.5-7B-Instruct-ReasonRAG",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/reasonrag/Qwen2.5-7B-Instruct-ReasonRAG

SGLang

How to use reasonrag/Qwen2.5-7B-Instruct-ReasonRAG with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "reasonrag/Qwen2.5-7B-Instruct-ReasonRAG" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "reasonrag/Qwen2.5-7B-Instruct-ReasonRAG",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "reasonrag/Qwen2.5-7B-Instruct-ReasonRAG" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "reasonrag/Qwen2.5-7B-Instruct-ReasonRAG",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use reasonrag/Qwen2.5-7B-Instruct-ReasonRAG with Docker Model Runner:
```
docker model run hf.co/reasonrag/Qwen2.5-7B-Instruct-ReasonRAG
```

Qwen2.5-7B-Instruct-ReasonRAG

Commit History

Upload training_args.bin

c668a3f
verified

Wenlin Zhang commited on May 19, 2025

Upload tokenizer_config.json

405d227
verified

Wenlin Zhang commited on May 19, 2025

Upload model.safetensors.index.json

b1b4c8d
verified

Wenlin Zhang commited on May 19, 2025

Upload model-00001-of-00004.safetensors

a98a3d8
verified

Wenlin Zhang commited on May 19, 2025

Upload config.json

52ce22c
verified

Wenlin Zhang commited on May 19, 2025

Upload special_tokens_map.json

0394261
verified

Wenlin Zhang commited on May 19, 2025

Upload model-00004-of-00004.safetensors

95f1f01
verified

Wenlin Zhang commited on May 19, 2025

Upload merges.txt

5ee4e6d
verified

Wenlin Zhang commited on May 19, 2025

Upload model-00003-of-00004.safetensors

2111a4f
verified

Wenlin Zhang commited on May 19, 2025

Upload generation_config.json

1f9b846
verified

Wenlin Zhang commited on May 19, 2025

Upload vocab.json

04fdc75
verified

Wenlin Zhang commited on May 19, 2025

Upload tokenizer.json

df3039e
verified

Wenlin Zhang commited on May 19, 2025

Upload README.md

e400b7c
verified

Wenlin Zhang commited on May 19, 2025

Upload model-00002-of-00004.safetensors

e08fb08
verified

Wenlin Zhang commited on May 19, 2025

Upload added_tokens.json

24941ad
verified

Wenlin Zhang commited on May 19, 2025

initial commit

d6ad0b5
verified

Wenlin Zhang commited on May 19, 2025

Commit History

Upload training_args.bin c668a3f verified

Upload tokenizer_config.json 405d227 verified

Upload model.safetensors.index.json b1b4c8d verified

Upload model-00001-of-00004.safetensors a98a3d8 verified

Upload config.json 52ce22c verified

Upload special_tokens_map.json 0394261 verified

Upload model-00004-of-00004.safetensors 95f1f01 verified

Upload merges.txt 5ee4e6d verified

Upload model-00003-of-00004.safetensors 2111a4f verified

Upload generation_config.json 1f9b846 verified

Upload vocab.json 04fdc75 verified

Upload tokenizer.json df3039e verified

Upload README.md e400b7c verified

Upload model-00002-of-00004.safetensors e08fb08 verified

Upload added_tokens.json 24941ad verified

initial commit d6ad0b5 verified

Upload training_args.bin

c668a3f
verified

Upload tokenizer_config.json

405d227
verified

Upload model.safetensors.index.json

b1b4c8d
verified

Upload model-00001-of-00004.safetensors

a98a3d8
verified

Upload config.json

52ce22c
verified

Upload special_tokens_map.json

0394261
verified

Upload model-00004-of-00004.safetensors

95f1f01
verified

Upload merges.txt

5ee4e6d
verified

Upload model-00003-of-00004.safetensors

2111a4f
verified

Upload generation_config.json

1f9b846
verified

Upload vocab.json

04fdc75
verified

Upload tokenizer.json

df3039e
verified

Upload README.md

e400b7c
verified

Upload model-00002-of-00004.safetensors

e08fb08
verified

Upload added_tokens.json

24941ad
verified

initial commit

d6ad0b5
verified