Text Generation
Transformers
TensorBoard
Safetensors
gpt2
Generated from Trainer
text-generation-inference
Instructions to use agaresd/tiny_gpt_deepL with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use agaresd/tiny_gpt_deepL with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="agaresd/tiny_gpt_deepL")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("agaresd/tiny_gpt_deepL") model = AutoModelForCausalLM.from_pretrained("agaresd/tiny_gpt_deepL", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use agaresd/tiny_gpt_deepL with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "agaresd/tiny_gpt_deepL" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "agaresd/tiny_gpt_deepL", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/agaresd/tiny_gpt_deepL
- SGLang
How to use agaresd/tiny_gpt_deepL with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "agaresd/tiny_gpt_deepL" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "agaresd/tiny_gpt_deepL", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "agaresd/tiny_gpt_deepL" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "agaresd/tiny_gpt_deepL", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use agaresd/tiny_gpt_deepL with Docker Model Runner:
docker model run hf.co/agaresd/tiny_gpt_deepL
Training in progress, step 500
Browse files- model.safetensors +1 -1
- runs/Dec06_20-32-15_d917d2391e67/events.out.tfevents.1733517136.d917d2391e67.408.1 +2 -2
- runs/Dec06_20-33-09_d917d2391e67/events.out.tfevents.1733517189.d917d2391e67.408.2 +2 -2
- runs/Dec06_20-37-58_d917d2391e67/events.out.tfevents.1733517479.d917d2391e67.408.5 +3 -0
- training_args.bin +1 -1
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 413296
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:198bfea33f6422d6528aec4855deaa50d175ef16b7b6116048ea8c0484a6e52d
|
| 3 |
size 413296
|
runs/Dec06_20-32-15_d917d2391e67/events.out.tfevents.1733517136.d917d2391e67.408.1
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f5f3a112042879f7cd9af3410810a3d372662835b639c90bf188cb24ef3a50be
|
| 3 |
+
size 5298
|
runs/Dec06_20-33-09_d917d2391e67/events.out.tfevents.1733517189.d917d2391e67.408.2
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9be55d3e8cf750f4a5c5bd7964aef0c1f4b0aa53d6528f05ac1ea1e3d8b399df
|
| 3 |
+
size 5298
|
runs/Dec06_20-37-58_d917d2391e67/events.out.tfevents.1733517479.d917d2391e67.408.5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e4fe3194b616689d9c33edcb8eb24164b1f1636b190fb00ede3e0dde9a8a8ada
|
| 3 |
+
size 6039
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 5304
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:34626b66adf94c27190f672687438cb4cc3e43d549b7b77ae5360884d978b41a
|
| 3 |
size 5304
|