Instructions to use transformersbook/codeparrot with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use transformersbook/codeparrot with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="transformersbook/codeparrot")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("transformersbook/codeparrot")
model = AutoModelForCausalLM.from_pretrained("transformersbook/codeparrot")

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use transformersbook/codeparrot with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "transformersbook/codeparrot"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "transformersbook/codeparrot",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/transformersbook/codeparrot

SGLang

How to use transformersbook/codeparrot with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "transformersbook/codeparrot" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "transformersbook/codeparrot",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "transformersbook/codeparrot" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "transformersbook/codeparrot",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use transformersbook/codeparrot with Docker Model Runner:
```
docker model run hf.co/transformersbook/codeparrot
```

lvwerra HF Staff commited on Sep 22, 2021

Commit

3f342b5

1 Parent(s): 6faf093

step 200000

Browse files

Files changed (7) hide show

log/debug_0.log +2 -2
pytorch_model.bin +1 -1
runs/Sep20_14-28-12_leandro-16x-v100/events.out.tfevents.1632148092.leandro-16x-v100.8660.0 +2 -2
wandb/run-20210920_142810-36cw69uv/files/output.log +2 -2
wandb/run-20210920_142810-36cw69uv/files/wandb-summary.json +1 -1
wandb/run-20210920_142810-36cw69uv/logs/debug-internal.log +2 -2
wandb/run-20210920_142810-36cw69uv/run-36cw69uv.wandb +2 -2

log/debug_0.log CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f88a933bed21fab0923735da5a401d3a9cfb26e6e306dd67b7b9daad8ac64f25
-size 22726521

 version https://git-lfs.github.com/spec/v1
+oid sha256:8c5757986c4ea6fc3ed4db55cbebd05710748f0a5dd6acd61fc5505f6ea51f64
+size 30402713

pytorch_model.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:dfdcae5bac72011f6b8c8865d2b1a22c8fb680769d8b91f7634cbb11640f45d2
 size 6169094681

 version https://git-lfs.github.com/spec/v1
+oid sha256:2cc45a4e373ef496ded651f7135867ea6d6049598bf4b4adfea0c37e897965c6
 size 6169094681

runs/Sep20_14-28-12_leandro-16x-v100/events.out.tfevents.1632148092.leandro-16x-v100.8660.0 CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:145e2dda8b213d0f7127d850371c9c925c07dae25c3ce049d58ed69ac3621a59
-size 27534297

 version https://git-lfs.github.com/spec/v1
+oid sha256:fbe05551c8ca26143a66ce642fbd20828fe599a5ca77384868a2cfdbdb972b09
+size 36734396

wandb/run-20210920_142810-36cw69uv/files/output.log CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f01ca0d560aae1617bec60b02fa6f919110779de92ac55567385a5fa354cf054
-size 26382864

 version https://git-lfs.github.com/spec/v1
+oid sha256:9fd6c2e467a0aa2f5577603b0070b47ccc2c8227772ffeae8343e35e706aceb6
+size 35803871

wandb/run-20210920_142810-36cw69uv/files/wandb-summary.json CHANGED Viewed

	@@ -1 +1 @@
1	- {"lr": 0.~~00018524651366935656~~, "samples": ~~4800000~~, "steps": ~~9374~~, "loss/train": 0.~~362652987241745~~, "_runtime": ~~122431~~, "_timestamp": ~~1632270521~~, "_step": ~~150002~~, "loss/eval": 1.~~0504040718078613~~, "perplexity": 2.~~8588061332702637~~}


1	+ {"lr": 0.0001732061452060258, "samples": 6400000, "steps": 12499, "loss/train": 0.9718689918518066, "_runtime": 163307, "_timestamp": 1632311397, "_step": 200003, "loss/eval": 0.9455239772796631, "perplexity": 2.5741617679595947}

wandb/run-20210920_142810-36cw69uv/logs/debug-internal.log CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6f03ad72a0a014afe95fa65dde813fcabefcc92c45e514049625a78100219649
-size 80036441

 version https://git-lfs.github.com/spec/v1
+oid sha256:53ed0d0bf0cff2d825431a3dec8fa9b1cdfc946f21786e2e1dcdf3dd2c29e76e
+size 106706093

wandb/run-20210920_142810-36cw69uv/run-36cw69uv.wandb CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:725812377444d66c9fc861693db9fe9f73518488db3a0f0ed07df48197d8d61d
-size 64605220

 version https://git-lfs.github.com/spec/v1
+oid sha256:b6295166cf534176fcfb94d338d3953b5490bb5252b4c1b74817a93dd5662199
+size 86961034