Text Generation
Transformers
Safetensors
qwen2
Generated from Trainer
open-r1
dapo
trl
conversational
text-generation-inference
Instructions to use kangdawei/DAPO-7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use kangdawei/DAPO-7B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="kangdawei/DAPO-7B") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("kangdawei/DAPO-7B") model = AutoModelForCausalLM.from_pretrained("kangdawei/DAPO-7B") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Inference
- Local Apps Settings
- vLLM
How to use kangdawei/DAPO-7B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "kangdawei/DAPO-7B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kangdawei/DAPO-7B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/kangdawei/DAPO-7B
- SGLang
How to use kangdawei/DAPO-7B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "kangdawei/DAPO-7B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kangdawei/DAPO-7B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "kangdawei/DAPO-7B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kangdawei/DAPO-7B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use kangdawei/DAPO-7B with Docker Model Runner:
docker model run hf.co/kangdawei/DAPO-7B
Training in progress, step 70
Browse files- adapter_model.safetensors +1 -1
- dynamic_sampling_log.txt +80 -0
adapter_model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 323014560
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8152e01abe0344b9060925fd55f55959c91a5353a5a38e906b57e774081bea0f
|
| 3 |
size 323014560
|
dynamic_sampling_log.txt
CHANGED
|
@@ -483,3 +483,83 @@ Step Attempts Total Prompts Valid Prompts Efficiency
|
|
| 483 |
59 1 6 6 100.0 %
|
| 484 |
59 1 6 6 100.0 %
|
| 485 |
59 3 18 6 33.3 %
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 483 |
59 1 6 6 100.0 %
|
| 484 |
59 1 6 6 100.0 %
|
| 485 |
59 3 18 6 33.3 %
|
| 486 |
+
60 1 6 6 100.0 %
|
| 487 |
+
60 3 18 6 33.3 %
|
| 488 |
+
60 2 12 6 50.0 %
|
| 489 |
+
60 6 36 6 16.7 %
|
| 490 |
+
60 7 42 6 14.3 %
|
| 491 |
+
60 3 18 6 33.3 %
|
| 492 |
+
60 3 18 6 33.3 %
|
| 493 |
+
60 3 18 6 33.3 %
|
| 494 |
+
61 5 30 6 20.0 %
|
| 495 |
+
61 5 30 6 20.0 %
|
| 496 |
+
61 4 24 6 25.0 %
|
| 497 |
+
61 5 30 6 20.0 %
|
| 498 |
+
61 1 6 6 100.0 %
|
| 499 |
+
61 2 12 6 50.0 %
|
| 500 |
+
61 2 12 6 50.0 %
|
| 501 |
+
61 3 18 6 33.3 %
|
| 502 |
+
62 3 18 6 33.3 %
|
| 503 |
+
62 2 12 6 50.0 %
|
| 504 |
+
62 2 12 6 50.0 %
|
| 505 |
+
62 2 12 6 50.0 %
|
| 506 |
+
62 2 12 6 50.0 %
|
| 507 |
+
62 1 6 6 100.0 %
|
| 508 |
+
62 3 18 6 33.3 %
|
| 509 |
+
62 4 24 6 25.0 %
|
| 510 |
+
63 5 30 6 20.0 %
|
| 511 |
+
63 1 6 6 100.0 %
|
| 512 |
+
63 4 24 6 25.0 %
|
| 513 |
+
63 5 30 6 20.0 %
|
| 514 |
+
63 4 24 6 25.0 %
|
| 515 |
+
63 1 6 6 100.0 %
|
| 516 |
+
63 2 12 6 50.0 %
|
| 517 |
+
63 1 6 6 100.0 %
|
| 518 |
+
64 1 6 6 100.0 %
|
| 519 |
+
64 9 54 6 11.1 %
|
| 520 |
+
64 1 6 6 100.0 %
|
| 521 |
+
64 4 24 6 25.0 %
|
| 522 |
+
64 2 12 6 50.0 %
|
| 523 |
+
64 1 6 6 100.0 %
|
| 524 |
+
64 1 6 6 100.0 %
|
| 525 |
+
64 2 12 6 50.0 %
|
| 526 |
+
65 2 12 6 50.0 %
|
| 527 |
+
65 5 30 6 20.0 %
|
| 528 |
+
65 1 6 6 100.0 %
|
| 529 |
+
65 4 24 6 25.0 %
|
| 530 |
+
65 3 18 6 33.3 %
|
| 531 |
+
65 2 12 6 50.0 %
|
| 532 |
+
65 1 6 6 100.0 %
|
| 533 |
+
65 6 36 6 16.7 %
|
| 534 |
+
66 3 18 6 33.3 %
|
| 535 |
+
66 2 12 6 50.0 %
|
| 536 |
+
66 1 6 6 100.0 %
|
| 537 |
+
66 2 12 6 50.0 %
|
| 538 |
+
66 4 24 6 25.0 %
|
| 539 |
+
66 5 30 6 20.0 %
|
| 540 |
+
66 4 24 6 25.0 %
|
| 541 |
+
66 1 6 6 100.0 %
|
| 542 |
+
67 3 18 6 33.3 %
|
| 543 |
+
67 3 18 6 33.3 %
|
| 544 |
+
67 5 30 6 20.0 %
|
| 545 |
+
67 4 24 6 25.0 %
|
| 546 |
+
67 2 12 6 50.0 %
|
| 547 |
+
67 3 18 6 33.3 %
|
| 548 |
+
67 1 6 6 100.0 %
|
| 549 |
+
67 3 18 6 33.3 %
|
| 550 |
+
68 2 12 6 50.0 %
|
| 551 |
+
68 2 12 6 50.0 %
|
| 552 |
+
68 6 36 6 16.7 %
|
| 553 |
+
68 5 30 6 20.0 %
|
| 554 |
+
68 2 12 6 50.0 %
|
| 555 |
+
68 4 24 6 25.0 %
|
| 556 |
+
68 2 12 6 50.0 %
|
| 557 |
+
68 2 12 6 50.0 %
|
| 558 |
+
69 2 12 6 50.0 %
|
| 559 |
+
69 4 24 6 25.0 %
|
| 560 |
+
69 1 6 6 100.0 %
|
| 561 |
+
69 2 12 6 50.0 %
|
| 562 |
+
69 6 36 6 16.7 %
|
| 563 |
+
69 3 18 6 33.3 %
|
| 564 |
+
69 3 18 6 33.3 %
|
| 565 |
+
69 6 36 6 16.7 %
|