Text Generation
Transformers
PyTorch
TensorBoard
gpt2
Generated from Trainer
text-generation-inference
Instructions to use hamonk/fairytale-ds with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use hamonk/fairytale-ds with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="hamonk/fairytale-ds")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("hamonk/fairytale-ds") model = AutoModelForCausalLM.from_pretrained("hamonk/fairytale-ds", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use hamonk/fairytale-ds with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "hamonk/fairytale-ds" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "hamonk/fairytale-ds", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/hamonk/fairytale-ds
- SGLang
How to use hamonk/fairytale-ds with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "hamonk/fairytale-ds" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "hamonk/fairytale-ds", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "hamonk/fairytale-ds" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "hamonk/fairytale-ds", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use hamonk/fairytale-ds with Docker Model Runner:
docker model run hf.co/hamonk/fairytale-ds
Training completed!
Browse files- pytorch_model.bin +1 -1
- runs/May29_16-16-40_DFWLRND0013/1685395142.7405388/events.out.tfevents.1685395142.DFWLRND0013.60102.1 +3 -0
- runs/May29_16-16-40_DFWLRND0013/events.out.tfevents.1685395142.DFWLRND0013.60102.0 +3 -0
- runs/May29_16-32-51_DFWLRND0013/1685395974.187226/events.out.tfevents.1685395974.DFWLRND0013.60468.1 +3 -0
- runs/May29_16-32-51_DFWLRND0013/events.out.tfevents.1685395974.DFWLRND0013.60468.0 +3 -0
- runs/May29_16-44-58_DFWLRND0013/1685396701.2845209/events.out.tfevents.1685396701.DFWLRND0013.60713.1 +3 -0
- runs/May29_16-44-58_DFWLRND0013/events.out.tfevents.1685396701.DFWLRND0013.60713.0 +3 -0
- training_args.bin +1 -1
pytorch_model.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 510396022
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fff3ea8ba40f87c142ca0f4d6dc399bc52d8976b843136d4300fe6b3a361f2b8
|
| 3 |
size 510396022
|
runs/May29_16-16-40_DFWLRND0013/1685395142.7405388/events.out.tfevents.1685395142.DFWLRND0013.60102.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9292b25f7d0d73b5596788cad5d6356225fb5370425cf75fef363987598bb55b
|
| 3 |
+
size 5897
|
runs/May29_16-16-40_DFWLRND0013/events.out.tfevents.1685395142.DFWLRND0013.60102.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:09b5fe27238ff0fc7f961268e3dacd76a4ff1e014b29df1d37abe7f4b8121daa
|
| 3 |
+
size 4235
|
runs/May29_16-32-51_DFWLRND0013/1685395974.187226/events.out.tfevents.1685395974.DFWLRND0013.60468.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:177c77351b6adb0599f0c116c4f2b5a01900f59254f1c84f8c3d3d2300ea24d6
|
| 3 |
+
size 5897
|
runs/May29_16-32-51_DFWLRND0013/events.out.tfevents.1685395974.DFWLRND0013.60468.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8c9c709da4949f5af3a006192a4ab0d845fcc50b15cd821fdea988f7cd9b7209
|
| 3 |
+
size 4390
|
runs/May29_16-44-58_DFWLRND0013/1685396701.2845209/events.out.tfevents.1685396701.DFWLRND0013.60713.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:652858942f9e169db0948318210ec7b946bc50098e87261a0acce190361b2621
|
| 3 |
+
size 5897
|
runs/May29_16-44-58_DFWLRND0013/events.out.tfevents.1685396701.DFWLRND0013.60713.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:32931d7292123190085bc71e62d9aa02f30a895007a2a1c3a77b5389ea622b5d
|
| 3 |
+
size 4583
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4340
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:206c32425d0f72c5bdec9f471f28d0fad26b657ca4ab99f777482bea78cf16a4
|
| 3 |
size 4340
|