Instructions to use jonng1000/git-base-pokemon with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use jonng1000/git-base-pokemon with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="jonng1000/git-base-pokemon")

# Load model directly
from transformers import AutoProcessor, AutoModelForImageTextToText

processor = AutoProcessor.from_pretrained("jonng1000/git-base-pokemon")
model = AutoModelForImageTextToText.from_pretrained("jonng1000/git-base-pokemon")

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use jonng1000/git-base-pokemon with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "jonng1000/git-base-pokemon"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "jonng1000/git-base-pokemon",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/jonng1000/git-base-pokemon

SGLang

How to use jonng1000/git-base-pokemon with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "jonng1000/git-base-pokemon" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "jonng1000/git-base-pokemon",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "jonng1000/git-base-pokemon" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "jonng1000/git-base-pokemon",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use jonng1000/git-base-pokemon with Docker Model Runner:
```
docker model run hf.co/jonng1000/git-base-pokemon
```

jonng1000 commited on Jul 30, 2023

Commit

c085f88

1 Parent(s): 0d70949

Model save

Browse files

Files changed (6) hide show

generation_config.json +7 -0
pytorch_model.bin +1 -1
runs/Jul29_10-14-21_192-9-147-21/events.out.tfevents.1690625666.192-9-147-21.169310.0 +2 -2
runs/Jul30_03-29-26_192-9-147-21/events.out.tfevents.1690687774.192-9-147-21.244221.0 +3 -0
runs/Jul30_03-30-10_192-9-147-21/events.out.tfevents.1690687815.192-9-147-21.244221.1 +3 -0
training_args.bin +1 -1

generation_config.json ADDED Viewed

	@@ -0,0 +1,7 @@

+{
+  "_from_model_config": true,
+  "bos_token_id": 101,
+  "eos_token_id": 102,
+  "pad_token_id": 0,
+  "transformers_version": "4.31.0"
+}

pytorch_model.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2546a44994875cda34cfbe65181bd6ac883d7cf6c5c237dfba58d3641e08b8b3
 size 706584273

 version https://git-lfs.github.com/spec/v1
+oid sha256:80cb7072087168c13cc3e347c8d10a791351ccdf2b56756c04e8ac5d0ef40595
 size 706584273

runs/Jul29_10-14-21_192-9-147-21/events.out.tfevents.1690625666.192-9-147-21.169310.0 CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3b4495eaa36c7f140d98829dcee3cf3cfe42fb5837a3ea2ed29a3d47af9eec9a
-size 24048

 version https://git-lfs.github.com/spec/v1
+oid sha256:e59004ba7ad19f8aeeb6c0e35b9edaf866eefd1cd5d0a101e678669e04eecd38
+size 24402

runs/Jul30_03-29-26_192-9-147-21/events.out.tfevents.1690687774.192-9-147-21.244221.0 ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:dec98a169f9d348fcc2dd7f07fa168341b58da701267f932da473dff74ee5ae7
+size 6653

runs/Jul30_03-30-10_192-9-147-21/events.out.tfevents.1690687815.192-9-147-21.244221.1 ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:94f8228f8fbbb35d20101050d60fb80d21f5e495c906fdc8397ddef4c16a7f99
+size 6653

training_args.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e4770a3f2c311f08f4b4cac9ef75c770bb814916275deae0246f07229be4272a
 size 3963

 version https://git-lfs.github.com/spec/v1
+oid sha256:f1d7e7bc20157dc23228e74c6e5b436fd7cad6a7c31836ed8ecf42037c8eb3e7
 size 3963