Instructions to use EssentialAI/rnj-1.5-instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use EssentialAI/rnj-1.5-instruct with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="EssentialAI/rnj-1.5-instruct")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("EssentialAI/rnj-1.5-instruct")
model = AutoModelForCausalLM.from_pretrained("EssentialAI/rnj-1.5-instruct")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use EssentialAI/rnj-1.5-instruct with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "EssentialAI/rnj-1.5-instruct"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "EssentialAI/rnj-1.5-instruct",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/EssentialAI/rnj-1.5-instruct

SGLang

How to use EssentialAI/rnj-1.5-instruct with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "EssentialAI/rnj-1.5-instruct" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "EssentialAI/rnj-1.5-instruct",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "EssentialAI/rnj-1.5-instruct" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "EssentialAI/rnj-1.5-instruct",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use EssentialAI/rnj-1.5-instruct with Docker Model Runner:
```
docker model run hf.co/EssentialAI/rnj-1.5-instruct
```

rnj-1.5-instruct

Commit History

Update README.md

126e2fb
verified

Research-EAI commited on about 22 hours ago

Update README.md

0be8d15
verified

Research-EAI commited on about 22 hours ago

Update README.md

794ecdc
verified

Research-EAI commited on about 22 hours ago

Update README.md

cf59c65
verified

Research-EAI commited on about 22 hours ago

Adding README.md

ea7ace4
verified

Research-EAI commited on about 22 hours ago

remove unused configs

b3675a3

Philip Monk commited on Apr 22

Upload folder using huggingface_hub

8126718
verified

Research-EAI commited on Apr 22

initial commit

29c6361
verified

Research-EAI commited on Apr 22

Commit History

Update README.md 126e2fb verified

Update README.md 0be8d15 verified

Update README.md 794ecdc verified

Update README.md cf59c65 verified

Adding README.md ea7ace4 verified

remove unused configs b3675a3

Upload folder using huggingface_hub 8126718 verified

initial commit 29c6361 verified

Update README.md

126e2fb
verified

Update README.md

0be8d15
verified

Update README.md

794ecdc
verified

Update README.md

cf59c65
verified

Adding README.md

ea7ace4
verified

remove unused configs

b3675a3

Upload folder using huggingface_hub

8126718
verified

initial commit

29c6361
verified