Instructions to use BAAI/AquilaMed-RL with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use BAAI/AquilaMed-RL with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="BAAI/AquilaMed-RL", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("BAAI/AquilaMed-RL", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use BAAI/AquilaMed-RL with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "BAAI/AquilaMed-RL"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "BAAI/AquilaMed-RL",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/BAAI/AquilaMed-RL

SGLang

How to use BAAI/AquilaMed-RL with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "BAAI/AquilaMed-RL" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "BAAI/AquilaMed-RL",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "BAAI/AquilaMed-RL" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "BAAI/AquilaMed-RL",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use BAAI/AquilaMed-RL with Docker Model Runner:
```
docker model run hf.co/BAAI/AquilaMed-RL
```

AquilaMed-RL

Commit History

Update README.md

0f4f1a3
verified

shixiaofeng commited on Jun 21, 2024

Update README.md

5ab7e36
verified

shixiaofeng commited on Jun 13, 2024

Update README.md

57f4341
verified

shixiaofeng commited on Jun 13, 2024

updata

2ab5596
verified

shixiaofeng commited on Jun 13, 2024

Update README.md

41e851e
verified

shixiaofeng commited on Jun 13, 2024

Upload 6 files

f73e5ce
verified

shixiaofeng commited on Jun 13, 2024

Upload README.md

43e4cc8
verified

shixiaofeng commited on Jun 13, 2024

Upload README.md

ace5095
verified

shixiaofeng commited on Jun 13, 2024

Upload 2 files

e4ef55a
verified

shixiaofeng commited on Jun 13, 2024

Upload README.md

535954a
verified

shixiaofeng commited on Jun 13, 2024

Upload README.md

d0bff7c
verified

shixiaofeng commited on Jun 12, 2024

Upload 3 files

4a49479
verified

shixiaofeng commited on Jun 12, 2024

Upload 18 files

7d3f15f
verified

shixiaofeng commited on Jun 12, 2024

initial commit

0c87b6a
verified

shixiaofeng commited on Jun 12, 2024

Commit History

Update README.md 0f4f1a3 verified

Update README.md 5ab7e36 verified

Update README.md 57f4341 verified

updata 2ab5596 verified

Update README.md 41e851e verified

Upload 6 files f73e5ce verified

Upload README.md 43e4cc8 verified

Upload README.md ace5095 verified

Upload 2 files e4ef55a verified

Upload README.md 535954a verified

Upload README.md d0bff7c verified

Upload 3 files 4a49479 verified

Upload 18 files 7d3f15f verified

initial commit 0c87b6a verified

Update README.md

0f4f1a3
verified

Update README.md

5ab7e36
verified

Update README.md

57f4341
verified

updata

2ab5596
verified

Update README.md

41e851e
verified

Upload 6 files

f73e5ce
verified

Upload README.md

43e4cc8
verified

Upload README.md

ace5095
verified

Upload 2 files

e4ef55a
verified

Upload README.md

535954a
verified

Upload README.md

d0bff7c
verified

Upload 3 files

4a49479
verified

Upload 18 files

7d3f15f
verified

initial commit

0c87b6a
verified