Instructions to use driaforall/mem-agent with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use driaforall/mem-agent with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="driaforall/mem-agent")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("driaforall/mem-agent")
model = AutoModelForCausalLM.from_pretrained("driaforall/mem-agent")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use driaforall/mem-agent with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "driaforall/mem-agent"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "driaforall/mem-agent",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/driaforall/mem-agent

SGLang

How to use driaforall/mem-agent with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "driaforall/mem-agent" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "driaforall/mem-agent",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "driaforall/mem-agent" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "driaforall/mem-agent",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use driaforall/mem-agent with Docker Model Runner:
```
docker model run hf.co/driaforall/mem-agent
```

mem-agent

Commit History

fix: Fixing model size issue

b409b82
verified

AtakanTekparmak commited on Sep 17, 2025

Adding `transformers` as the library tag (#4)

d42f844
verified

andthattoo

ariG23498 HF Staff commited on Sep 17, 2025

Create LICENSE

6dd45c3
verified

AtakanTekparmak commited on Sep 13, 2025

Update README.md (#1)

a3f853b
verified

andthattoo

codelion commited on Sep 11, 2025

Update README.md

34887e4
verified

andthattoo commited on Sep 11, 2025

Update README.md

9416a84
verified

AtakanTekparmak commited on Sep 9, 2025

feat: Updated README

681ae06
verified

AtakanTekparmak commited on Sep 5, 2025

Update README.md

51bc8d8
verified

andthattoo commited on Sep 5, 2025

Create README.md

1cbb53d
verified

andthattoo commited on Aug 30, 2025

Upload folder using huggingface_hub

d020361
verified

AtakanTekparmak commited on Aug 29, 2025

initial commit

897265a
verified

AtakanTekparmak commited on Aug 29, 2025

Commit History

fix: Fixing model size issue b409b82 verified

Adding `transformers` as the library tag (#4) d42f844 verified

Create LICENSE 6dd45c3 verified

Update README.md (#1) a3f853b verified

Update README.md 34887e4 verified

Update README.md 9416a84 verified

feat: Updated README 681ae06 verified

Update README.md 51bc8d8 verified

Create README.md 1cbb53d verified

Upload folder using huggingface_hub d020361 verified

initial commit 897265a verified