Instructions to use AIgot/copywriting with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use AIgot/copywriting with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="AIgot/copywriting")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("AIgot/copywriting") model = AutoModelForCausalLM.from_pretrained("AIgot/copywriting") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use AIgot/copywriting with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "AIgot/copywriting" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AIgot/copywriting", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/AIgot/copywriting
- SGLang
How to use AIgot/copywriting with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "AIgot/copywriting" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AIgot/copywriting", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "AIgot/copywriting" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AIgot/copywriting", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use AIgot/copywriting with Docker Model Runner:
docker model run hf.co/AIgot/copywriting
Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,54 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: peft
|
| 3 |
+
base_model: mistralai/Mistral-7B-v0.1
|
| 4 |
+
---
|
| 5 |
+
| Step | Training Loss |
|
| 6 |
+
|-------|---------------|
|
| 7 |
+
| 25 | 1.180900 |
|
| 8 |
+
| 50 | 0.551100 |
|
| 9 |
+
| 75 | 0.833000 |
|
| 10 |
+
| 100 | 0.497000 |
|
| 11 |
+
| 125 | 0.770000 |
|
| 12 |
+
| 150 | 0.479200 |
|
| 13 |
+
| 175 | 0.686700 |
|
| 14 |
+
| 200 | 0.472500 |
|
| 15 |
+
| 225 | 0.684200 |
|
| 16 |
+
| 250 | 0.426900 |
|
| 17 |
+
| 275 | 0.693900 |
|
| 18 |
+
| 300 | 0.443500 |
|
| 19 |
+
| 325 | 0.697600 |
|
| 20 |
+
| 350 | 0.415000 |
|
| 21 |
+
| 375 | 0.666300 |
|
| 22 |
+
| 400 | 0.430500 |
|
| 23 |
+
| 425 | 0.697800 |
|
| 24 |
+
| 450 | 0.392000 |
|
| 25 |
+
| 475 | 0.664700 |
|
| 26 |
+
| 500 | 0.411900 |
|
| 27 |
+
| 525 | 0.636400 |
|
| 28 |
+
| 550 | 0.394900 |
|
| 29 |
+
| 575 | 0.603400 |
|
| 30 |
+
| 600 | 0.389000 |
|
| 31 |
+
| 625 | 0.645300 |
|
| 32 |
+
| 650 | 0.377600 |
|
| 33 |
+
| 675 | 0.563100 |
|
| 34 |
+
| 700 | 0.377100 |
|
| 35 |
+
| 725 | 0.580400 |
|
| 36 |
+
| 750 | 0.351300 |
|
| 37 |
+
| 775 | 0.539300 |
|
| 38 |
+
| 800 | 0.363600 |
|
| 39 |
+
| 825 | 0.527900 |
|
| 40 |
+
| 850 | 0.382100 |
|
| 41 |
+
| 875 | 0.528600 |
|
| 42 |
+
| 900 | 0.358800 |
|
| 43 |
+
| 925 | 0.551900 |
|
| 44 |
+
| 950 | 0.383300 |
|
| 45 |
+
| 975 | 0.503500 |
|
| 46 |
+
| 1000 | 0.317800 |
|
| 47 |
+
| 1025 | 0.535700 |
|
| 48 |
+
| 1050 | 0.332900 |
|
| 49 |
+
| 1075 | 0.475400 |
|
| 50 |
+
| 1100 | 0.312800 |
|
| 51 |
+
| 1125 | 0.565500 |
|
| 52 |
+
| 1150 | 0.367300 |
|
| 53 |
+
| 1175 | 0.499300 |
|
| 54 |
+
| 1200 | 0.339900 |
|