Instructions to use transformersbook/codeparrot-small with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use transformersbook/codeparrot-small with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="transformersbook/codeparrot-small")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("transformersbook/codeparrot-small")
model = AutoModelForCausalLM.from_pretrained("transformersbook/codeparrot-small")

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use transformersbook/codeparrot-small with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "transformersbook/codeparrot-small"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "transformersbook/codeparrot-small",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/transformersbook/codeparrot-small

SGLang

How to use transformersbook/codeparrot-small with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "transformersbook/codeparrot-small" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "transformersbook/codeparrot-small",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "transformersbook/codeparrot-small" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "transformersbook/codeparrot-small",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use transformersbook/codeparrot-small with Docker Model Runner:
```
docker model run hf.co/transformersbook/codeparrot-small
```

lvwerra HF Staff commited on Aug 31, 2021

Commit

5253b38

1 Parent(s): 8d530b8

step 105000

Browse files

Files changed (7) hide show

log/debug_0.log +2 -2
pytorch_model.bin +1 -1
runs/Aug30_13-13-56_leandro-16x-a100-v3/events.out.tfevents.1630329236.leandro-16x-a100-v3.9739.0 +2 -2
wandb/run-20210830_131354-2654p8r7/files/output.log +2 -2
wandb/run-20210830_131354-2654p8r7/files/wandb-summary.json +1 -1
wandb/run-20210830_131354-2654p8r7/logs/debug-internal.log +2 -2
wandb/run-20210830_131354-2654p8r7/run-2654p8r7.wandb +2 -2

log/debug_0.log CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:364b4cddf293ddf5dd0f7ed7efbde81cb970c9553ec902cbfe0cf70fcec44027
-size 13749000

 version https://git-lfs.github.com/spec/v1
+oid sha256:272d1ed8ad1cd9e6fc1c4b394d49f25ca1ff5ba25eef0da9e295381b7157b5be
+size 16063592

pytorch_model.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fed55ba8cccb1b44bc766ee5913b181011508b9133e2e2482b95bc72dc0fdb9a
 size 456677609

 version https://git-lfs.github.com/spec/v1
+oid sha256:a51dff6a106fbeb052cd51e9bbae6998b223ccdc7170939a18c73483e886c8c5
 size 456677609

runs/Aug30_13-13-56_leandro-16x-a100-v3/events.out.tfevents.1630329236.leandro-16x-a100-v3.9739.0 CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f493298754000712e67a25bda4b1c76a9459b5a0278bfe3b599985252c2d8503
-size 16494592

 version https://git-lfs.github.com/spec/v1
+oid sha256:da34a0aa41df061967725a0395662280c4af5dc59a93c93fe9d791f45378d6c2
+size 19254691

wandb/run-20210830_131354-2654p8r7/files/output.log CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8e55276f1b22bb3689a94dd02d46ac8ad87e4ce371ed3d8f6f1d6d061e48bc51
-size 13777008

 version https://git-lfs.github.com/spec/v1
+oid sha256:6a50815ffd18330290e91d6631b33ce776808abd0cb39ed736362828fc025be9
+size 16097728

wandb/run-20210830_131354-2654p8r7/files/wandb-summary.json CHANGED Viewed

	@@ -1 +1 @@
1	- {"lr": 0.~~00017679938132976936~~, "samples": ~~17280000~~, "steps": ~~89999~~, "loss/train": 1.~~803838849067688~~, "_runtime": ~~58808~~, "_timestamp": ~~1630388042~~, "_step": ~~90005~~, "loss/eval": 1.~~070123553276062~~, "perplexity": 2.~~9157397747039795~~}


1	+ {"lr": 0.00010564581571251794, "samples": 20160000, "steps": 104999, "loss/train": 0.7868649959564209, "_runtime": 68661, "_timestamp": 1630397895, "_step": 105006, "loss/eval": 1.020147442817688, "perplexity": 2.773603677749634}

wandb/run-20210830_131354-2654p8r7/logs/debug-internal.log CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e74b4066243d09ed264351556b2179acb0dccf4cd0d7a10db06ccc7a2bec7509
-size 42154971

 version https://git-lfs.github.com/spec/v1
+oid sha256:86df2d9af92a39090229d65fb34be385a7b6f61ed84ade9896e3ece1735e807e
+size 49185682

wandb/run-20210830_131354-2654p8r7/run-2654p8r7.wandb CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:cf3d4abae60b3cb1e873827ae539dc1851ab6e15c43f9eecbf0272f44cc31571
-size 34794428

 version https://git-lfs.github.com/spec/v1
+oid sha256:cef8fe409ba5e2c7c31dc1a50c0debd47b776a3c078a3c3b305899847d5274df
+size 40667019