Text Generation
Transformers
Safetensors
qwen2
Generated from Trainer
open-r1
dapo
trl
conversational
text-generation-inference
Instructions to use kangdawei/DAPO-7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use kangdawei/DAPO-7B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="kangdawei/DAPO-7B") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("kangdawei/DAPO-7B") model = AutoModelForCausalLM.from_pretrained("kangdawei/DAPO-7B") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Inference
- Local Apps Settings
- vLLM
How to use kangdawei/DAPO-7B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "kangdawei/DAPO-7B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kangdawei/DAPO-7B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/kangdawei/DAPO-7B
- SGLang
How to use kangdawei/DAPO-7B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "kangdawei/DAPO-7B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kangdawei/DAPO-7B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "kangdawei/DAPO-7B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kangdawei/DAPO-7B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use kangdawei/DAPO-7B with Docker Model Runner:
docker model run hf.co/kangdawei/DAPO-7B
Training in progress, step 130
Browse files- adapter_model.safetensors +1 -1
- dynamic_sampling_log.txt +80 -0
adapter_model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 323014560
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3aa4fb35c3ff972ed11a2efa6f2eafd1db510d013b3f124b13e58491eccd3df8
|
| 3 |
size 323014560
|
dynamic_sampling_log.txt
CHANGED
|
@@ -963,3 +963,83 @@ Step Attempts Total Prompts Valid Prompts Efficiency
|
|
| 963 |
119 1 6 6 100.0 %
|
| 964 |
119 4 24 6 25.0 %
|
| 965 |
119 3 18 6 33.3 %
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 963 |
119 1 6 6 100.0 %
|
| 964 |
119 4 24 6 25.0 %
|
| 965 |
119 3 18 6 33.3 %
|
| 966 |
+
120 1 6 6 100.0 %
|
| 967 |
+
120 1 6 6 100.0 %
|
| 968 |
+
120 2 12 6 50.0 %
|
| 969 |
+
120 3 18 6 33.3 %
|
| 970 |
+
120 5 30 6 20.0 %
|
| 971 |
+
120 2 12 6 50.0 %
|
| 972 |
+
120 4 24 6 25.0 %
|
| 973 |
+
120 3 18 6 33.3 %
|
| 974 |
+
121 4 24 6 25.0 %
|
| 975 |
+
121 10 60 6 10.0 %
|
| 976 |
+
121 5 30 6 20.0 %
|
| 977 |
+
121 6 36 6 16.7 %
|
| 978 |
+
121 6 36 6 16.7 %
|
| 979 |
+
121 4 24 6 25.0 %
|
| 980 |
+
121 2 12 6 50.0 %
|
| 981 |
+
121 1 6 6 100.0 %
|
| 982 |
+
122 5 30 6 20.0 %
|
| 983 |
+
122 3 18 6 33.3 %
|
| 984 |
+
122 1 6 6 100.0 %
|
| 985 |
+
122 1 6 6 100.0 %
|
| 986 |
+
122 8 48 6 12.5 %
|
| 987 |
+
122 2 12 6 50.0 %
|
| 988 |
+
122 2 12 6 50.0 %
|
| 989 |
+
122 2 12 6 50.0 %
|
| 990 |
+
123 4 24 6 25.0 %
|
| 991 |
+
123 5 30 6 20.0 %
|
| 992 |
+
123 4 24 6 25.0 %
|
| 993 |
+
123 3 18 6 33.3 %
|
| 994 |
+
123 4 24 6 25.0 %
|
| 995 |
+
123 1 6 6 100.0 %
|
| 996 |
+
123 4 24 6 25.0 %
|
| 997 |
+
123 3 18 6 33.3 %
|
| 998 |
+
124 8 48 6 12.5 %
|
| 999 |
+
124 3 18 6 33.3 %
|
| 1000 |
+
124 3 18 6 33.3 %
|
| 1001 |
+
124 3 18 6 33.3 %
|
| 1002 |
+
124 1 6 6 100.0 %
|
| 1003 |
+
124 1 6 6 100.0 %
|
| 1004 |
+
124 1 6 6 100.0 %
|
| 1005 |
+
124 3 18 6 33.3 %
|
| 1006 |
+
125 1 6 6 100.0 %
|
| 1007 |
+
125 2 12 6 50.0 %
|
| 1008 |
+
125 3 18 6 33.3 %
|
| 1009 |
+
125 10 60 6 10.0 %
|
| 1010 |
+
125 4 24 6 25.0 %
|
| 1011 |
+
125 5 30 6 20.0 %
|
| 1012 |
+
125 3 18 6 33.3 %
|
| 1013 |
+
125 5 30 6 20.0 %
|
| 1014 |
+
126 3 18 6 33.3 %
|
| 1015 |
+
126 2 12 6 50.0 %
|
| 1016 |
+
126 4 24 6 25.0 %
|
| 1017 |
+
126 3 18 6 33.3 %
|
| 1018 |
+
126 3 18 6 33.3 %
|
| 1019 |
+
126 4 24 6 25.0 %
|
| 1020 |
+
126 3 18 6 33.3 %
|
| 1021 |
+
126 4 24 6 25.0 %
|
| 1022 |
+
127 3 18 6 33.3 %
|
| 1023 |
+
127 2 12 6 50.0 %
|
| 1024 |
+
127 2 12 6 50.0 %
|
| 1025 |
+
127 2 12 6 50.0 %
|
| 1026 |
+
127 3 18 6 33.3 %
|
| 1027 |
+
127 3 18 6 33.3 %
|
| 1028 |
+
127 5 30 6 20.0 %
|
| 1029 |
+
127 1 6 6 100.0 %
|
| 1030 |
+
128 4 24 6 25.0 %
|
| 1031 |
+
128 4 24 6 25.0 %
|
| 1032 |
+
128 3 18 6 33.3 %
|
| 1033 |
+
128 3 18 6 33.3 %
|
| 1034 |
+
128 2 12 6 50.0 %
|
| 1035 |
+
128 1 6 6 100.0 %
|
| 1036 |
+
128 1 6 6 100.0 %
|
| 1037 |
+
128 9 54 6 11.1 %
|
| 1038 |
+
129 4 24 6 25.0 %
|
| 1039 |
+
129 1 6 6 100.0 %
|
| 1040 |
+
129 2 12 6 50.0 %
|
| 1041 |
+
129 2 12 6 50.0 %
|
| 1042 |
+
129 2 12 6 50.0 %
|
| 1043 |
+
129 2 12 6 50.0 %
|
| 1044 |
+
129 5 30 6 20.0 %
|
| 1045 |
+
129 3 18 6 33.3 %
|