Instructions to use rharris117/git-base-pokemon with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use rharris117/git-base-pokemon with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="rharris117/git-base-pokemon")

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("rharris117/git-base-pokemon")
model = AutoModelForMultimodalLM.from_pretrained("rharris117/git-base-pokemon")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use rharris117/git-base-pokemon with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "rharris117/git-base-pokemon"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "rharris117/git-base-pokemon",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/rharris117/git-base-pokemon

SGLang

How to use rharris117/git-base-pokemon with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "rharris117/git-base-pokemon" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "rharris117/git-base-pokemon",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "rharris117/git-base-pokemon" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "rharris117/git-base-pokemon",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use rharris117/git-base-pokemon with Docker Model Runner:
```
docker model run hf.co/rharris117/git-base-pokemon
```

rharris117 commited on Dec 28, 2023

Commit

4c943ea

1 Parent(s): d398b9a

Model save

Browse files

Files changed (3) hide show

README.md +16 -15
generation_config.json +1 -1
model.safetensors +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
 This model is a fine-tuned version of [microsoft/git-base](https://huggingface.co/microsoft/git-base) on an unknown dataset.
 It achieves the following results on the evaluation set:
 - Loss: 0.0362
-- Wer Score: 1.9038
 ## Model description
@@ -44,28 +44,29 @@ The following hyperparameters were used during training:
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - num_epochs: 50
 ### Training results
 | Training Loss | Epoch | Step | Validation Loss | Wer Score |
 |:-------------:|:-----:|:----:|:---------------:|:---------:|
-| 7.303         | 4.17  | 50   | 4.4592          | 8.1747    |
-| 2.2819        | 8.33  | 100  | 0.4176          | 7.8949    |
-| 0.1266        | 12.5  | 150  | 0.0331          | 0.4367    |
-| 0.0158        | 16.67 | 200  | 0.0292          | 1.3658    |
-| 0.0045        | 20.83 | 250  | 0.0340          | 2.0152    |
-| 0.0023        | 25.0  | 300  | 0.0349          | 2.2013    |
-| 0.0016        | 29.17 | 350  | 0.0350          | 2.6532    |
-| 0.0013        | 33.33 | 400  | 0.0356          | 2.1709    |
-| 0.0012        | 37.5  | 450  | 0.0357          | 2.0532    |
-| 0.0011        | 41.67 | 500  | 0.0360          | 2.1177    |
-| 0.001         | 45.83 | 550  | 0.0360          | 1.9127    |
-| 0.001         | 50.0  | 600  | 0.0362          | 1.9038    |
 ### Framework versions
-- Transformers 4.34.0
 - Pytorch 2.1.0+cu121
 - Datasets 2.14.7
-- Tokenizers 0.14.1

 This model is a fine-tuned version of [microsoft/git-base](https://huggingface.co/microsoft/git-base) on an unknown dataset.
 It achieves the following results on the evaluation set:
 - Loss: 0.0362
+- Wer Score: 3.5483
 ## Model description
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - num_epochs: 50
+- mixed_precision_training: Native AMP
 ### Training results
 | Training Loss | Epoch | Step | Validation Loss | Wer Score |
 |:-------------:|:-----:|:----:|:---------------:|:---------:|
+| 7.2786        | 4.17  | 50   | 4.4614          | 21.6293   |
+| 2.2929        | 8.33  | 100  | 0.4321          | 12.5212   |
+| 0.1294        | 12.5  | 150  | 0.0356          | 1.1338    |
+| 0.0142        | 16.67 | 200  | 0.0332          | 4.6898    |
+| 0.0039        | 20.83 | 250  | 0.0339          | 3.2767    |
+| 0.0021        | 25.0  | 300  | 0.0349          | 3.9781    |
+| 0.0016        | 29.17 | 350  | 0.0354          | 3.8867    |
+| 0.0013        | 33.33 | 400  | 0.0359          | 3.6744    |
+| 0.0012        | 37.5  | 450  | 0.0360          | 3.6564    |
+| 0.0011        | 41.67 | 500  | 0.0363          | 3.4659    |
+| 0.001         | 45.83 | 550  | 0.0363          | 3.5495    |
+| 0.001         | 50.0  | 600  | 0.0362          | 3.5483    |
 ### Framework versions
+- Transformers 4.36.2
 - Pytorch 2.1.0+cu121
 - Datasets 2.14.7
+- Tokenizers 0.15.0

generation_config.json CHANGED Viewed

@@ -3,5 +3,5 @@
   "bos_token_id": 101,
   "eos_token_id": 102,
   "pad_token_id": 0,
-  "transformers_version": "4.34.0"
 }

   "bos_token_id": 101,
   "eos_token_id": 102,
   "pad_token_id": 0,
+  "transformers_version": "4.36.2"
 }

model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:668064e90d6d4bbad9e96f04957de2d7335dea57cb0bfcb50a3b40cf96dfb5b5
 size 706516040

 version https://git-lfs.github.com/spec/v1
+oid sha256:35f222a8ede5d1e4558721ca76a4c389fc3f8c4e07da0fa5b4fffdcea80b0e87
 size 706516040