Text Generation
Transformers
Safetensors
English
reasoning
reinforcement-learning
synthetic-data
extrapolation
Instructions to use ZachW/extrapolation_rl with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ZachW/extrapolation_rl with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="ZachW/extrapolation_rl")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ZachW/extrapolation_rl", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use ZachW/extrapolation_rl with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "ZachW/extrapolation_rl" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ZachW/extrapolation_rl", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/ZachW/extrapolation_rl
- SGLang
How to use ZachW/extrapolation_rl with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "ZachW/extrapolation_rl" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ZachW/extrapolation_rl", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "ZachW/extrapolation_rl" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ZachW/extrapolation_rl", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use ZachW/extrapolation_rl with Docker Model Runner:
docker model run hf.co/ZachW/extrapolation_rl
Commit History
-
Update model card for intermediate checkpoints
Verified signaturea79ceda -
Upload extrapolation intermediate checkpoints
Verified signature469791c -
Add root model card
yichenw816f61f -
Add OPD sweep eval artifacts
yichenwd1d86a6 -
Upload extrapolation artifact: 050302 OPD Ref-KL step20 score report
Verified signature7d62058 -
Upload extrapolation artifact: 050302 OPD Ref-KL step20 graph aggregate results
Verified signatureacacd48 -
Upload extrapolation artifact: 050302 OPD Ref-KL step20 metrics
Verified signaturec31b45c -
Upload extrapolation artifact: 050302 OPD Ref-KL step20 summary JSON
Verified signature3dd83c7 -
Upload extrapolation artifact: 050302 OPD Ref-KL step20 summary CSV
Verified signature2a92446 -
Upload extrapolation model: 050302 OPD Ref-KL step180
Verified signature65d4ccb -
Upload extrapolation model: 050302 OPD Ref-KL step160
Verified signature29d79db -
Upload extrapolation model: 050302 OPD Ref-KL step140
Verified signature2960516 -
Upload extrapolation model: 050302 OPD Ref-KL step120
Verified signaturebe0131c -
Upload extrapolation model: 050302 OPD Ref-KL step100
Verified signaturee4b48ba -
Upload extrapolation model: 050302 OPD Ref-KL step80
Verified signature69b8302 -
Upload extrapolation model: 050302 OPD Ref-KL step60
Verified signature86e47e5 -
Upload extrapolation model: 050302 OPD Ref-KL step40
Verified signaturef429906 -
Upload extrapolation model: 050302 OPD Ref-KL step20
Verified signature0de2862 -
Upload extrapolation artifact: 050302 OPD Ref-KL OP13-20 step200 OOD per-sample graph results
Verified signaturea7364b5 -
Upload extrapolation artifact: 050302 OPD Ref-KL OP13-20 step200 ID per-sample graph results
Verified signature7ee795c -
Upload extrapolation artifact: 050302 RL OP15-20 step200 OOD per-sample graph results
Verified signatured7c9e58 -
Upload extrapolation artifact: 050302 RL OP15-20 step200 ID per-sample graph results
Verified signature4a7d538 -
Upload extrapolation artifact: 050302 RL OP13-20 step200 OOD per-sample graph results
Verified signatured6721b6 -
Upload extrapolation artifact: 050302 RL OP13-20 step200 ID per-sample graph results
Verified signatureac266d7 -
Upload extrapolation artifact: 050302 RL OP11-14 step200 OOD per-sample graph results
Verified signature6b8f8a8 -
Upload extrapolation artifact: 050302 RL OP11-14 step200 ID per-sample graph results
Verified signatureaf91f4a -
Upload extrapolation artifact: 050302 pretrain checkpoint-18586 OOD per-sample graph results
Verified signaturee8b7725 -
Upload extrapolation artifact: 050302 pretrain checkpoint-18586 ID per-sample graph results
Verified signature541567d -
Upload extrapolation artifact: 020305 OPD Ref-KL OP11-14 step200 OOD per-sample graph results
Verified signature5bf85b3 -
Upload extrapolation artifact: 020305 OPD Ref-KL OP11-14 step200 ID per-sample graph results
Verified signature060b169 -
Upload extrapolation artifact: 020305 RL OP15-20 step200 OOD per-sample graph results
Verified signature782aded -
Upload extrapolation artifact: 020305 RL OP15-20 step200 ID per-sample graph results
Verified signature7823903 -
Upload extrapolation artifact: 020305 RL OP13-20 step200 OOD per-sample graph results
Verified signature2ca16b8 -
Upload extrapolation artifact: 020305 RL OP13-20 step200 ID per-sample graph results
Verified signaturee0e1654 -
Upload extrapolation artifact: 020305 RL OP11-14 step200 OOD per-sample graph results
Verified signature69742ff -
Upload extrapolation artifact: 020305 RL OP11-14 step200 ID per-sample graph results
Verified signature09e9ffc -
Upload extrapolation artifact: 020305 pretrain checkpoint-18809 OOD per-sample graph results
Verified signature6eb08a7 -
Upload extrapolation artifact: 020305 pretrain checkpoint-18809 ID per-sample graph results
Verified signature8c8a3bc -
Upload extrapolation artifact: opd_ckpt18809_refkl_op11_14_s200_merged_hf far-OOD generations
Verified signature21168a1 -
Upload extrapolation artifact: rl_ckpt18809_op11_14_step200_merged_hf far-OOD generations
Verified signature4468aae -
Upload extrapolation artifact: pretrain_ckpt18809 far-OOD generations
Verified signaturedb0a617 -
Upload extrapolation artifact: 050302 OPD Ref-KL OP13-20 step200 OOD generations
Verified signatureb823521 -
Upload extrapolation artifact: 050302 OPD Ref-KL OP13-20 step200 ID generations
Verified signaturee10251a -
Upload extrapolation artifact: 050302 RL OP15-20 step200 OOD generations
Verified signature7b90e5a -
Upload extrapolation artifact: 050302 RL OP15-20 step200 ID generations
Verified signature3c71c9b -
Upload extrapolation artifact: 050302 RL OP13-20 step200 OOD generations
Verified signaturec2411d4 -
Upload extrapolation artifact: 050302 RL OP13-20 step200 ID generations
Verified signature5283d4f -
Upload extrapolation artifact: 050302 RL OP11-14 step200 OOD generations
Verified signature4d2fc67 -
Upload extrapolation artifact: 050302 RL OP11-14 step200 ID generations
Verified signature0341646 -
Upload extrapolation artifact: 050302 pretrain checkpoint-18586 OOD generations
Verified signature3774fa5