Text Generation
Transformers
PyTorch
Safetensors
gpt_bigcode
code
Eval Results (legacy)
text-generation-inference
Instructions to use nuprl/MultiPL-T-StarCoderBase_15b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use nuprl/MultiPL-T-StarCoderBase_15b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="nuprl/MultiPL-T-StarCoderBase_15b")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("nuprl/MultiPL-T-StarCoderBase_15b") model = AutoModelForCausalLM.from_pretrained("nuprl/MultiPL-T-StarCoderBase_15b", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use nuprl/MultiPL-T-StarCoderBase_15b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "nuprl/MultiPL-T-StarCoderBase_15b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nuprl/MultiPL-T-StarCoderBase_15b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/nuprl/MultiPL-T-StarCoderBase_15b
- SGLang
How to use nuprl/MultiPL-T-StarCoderBase_15b with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "nuprl/MultiPL-T-StarCoderBase_15b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nuprl/MultiPL-T-StarCoderBase_15b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "nuprl/MultiPL-T-StarCoderBase_15b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nuprl/MultiPL-T-StarCoderBase_15b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use nuprl/MultiPL-T-StarCoderBase_15b with Docker Model Runner:
docker model run hf.co/nuprl/MultiPL-T-StarCoderBase_15b
Commit History
-
Delete eval_rkt_checkpoint-308
Verified signaturec7e486f -
Upload folder using huggingface_hub
Verified signatureSC2-15B-selfinstruct001be6d
-
StarCoder_15b_r_v2_checkpoint_700
Verified signatured271f61 -
StarCoder_15b_r_v2_checkpoint_600
Verified signature64ea242 -
StarCoder_15b_r_v2_checkpoint_500
Verified signatured7895c0 -
StarCoder_15b_r_v2_checkpoint_400
Verified signature49f1c2f -
StarCoder_15b_r_v2_checkpoint_300
Verified signaturea4f5d92 -
StarCoder_15b_r_v2_checkpoint_200
Verified signatured67263f -
StarCoder_15b_r_v2_checkpoint_100
Verified signature534cdbf
-
model_starcoder15b_multiplt_jl_mixed-epoch6
d61912e -
model_starcoder15b_multiplt_jl_mixed-epoch5
a94c73f -
model_starcoder15b_multiplt_jl_mixed-epoch4
f579a20 -
model_starcoder15b_multiplt_jl_mixed-epoch3
8e85f46 -
model_starcoder15b_multiplt_jl_mixed-epoch2
2ffe542 -
model_starcoder15b_multiplt_jl_mixed-epoch1
df8b2be -
model_starcoder_15b_r-epoch6
36f6b5e -
model_starcoder_15b_r-epoch5
1a86335 -
model_starcoder_15b_r-epoch4
e635d39 -
model_starcoder_15b_r-epoch3
55c51bd -
model_starcoder_15b_r-epoch2
f811f0b -
model_starcoder_15b_r-epoch1
6d8dea3
-
model_starcoder15b_multiplt_jl-epoch6
a08675c -
model_starcoder15b_multiplt_jl-epoch5
4c7026e -
model_starcoder15b_multiplt_jl-epoch4
9807409 -
model_starcoder15b_multiplt_jl-epoch3
2d17234 -
model_starcoder15b_multiplt_jl-epoch2
e42d29c -
model_starcoder15b_multiplt_jl-epoch1
eee3c5e
-
Update README.md
9ee64ae -
Create README.md
9a56eb9 -
Upload tokenizer
55dc430
-
model_starcoder15b_all_lang_equal_paper-epoch10
f6e7c35 -
model_starcoder15b_all_lang_equal_paper-epoch9
c6941ee -
model_starcoder15b_all_lang_equal_paper-epoch8
671613a -
model_starcoder15b_all_lang_equal_paper-epoch7
1d70af8 -
model_starcoder15b_all_lang_equal_paper-epoch6
c1f985d -
model_starcoder15b_all_lang_equal_paper-epoch5
c75dfb8 -
model_starcoder15b_all_lang_equal_paper-epoch4
34ed28d -
model_starcoder15b_all_lang_equal_paper-epoch3
abd9106 -
model_starcoder15b_all_lang_equal_paper-epoch2
9986829 -
model_starcoder15b_all_lang_equal_paper-epoch1
0ca7db1 -
model_starcoder15b_all_lang_paper-epoch10
83275f4 -
model_starcoder15b_all_lang_paper-epoch9
bd49797 -
model_starcoder15b_all_lang_paper-epoch8
a0d0bff -
model_starcoder15b_all_lang_paper-epoch7
d5f80fe -
model_starcoder15b_all_lang_paper-epoch6
d488aef -
model_starcoder15b_all_lang_paper-epoch5
b9c3045 -
model_starcoder15b_all_lang_paper-epoch4
103cbf5 -
model_starcoder15b_all_lang_paper-epoch3
14d4b52 -
model_starcoder15b_all_lang_paper-epoch2
8fdf771 -
model_starcoder15b_all_lang_paper-epoch1
0bbebd6