Instructions to use Andrei-Alex/Fine-Tune-Adapters with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Andrei-Alex/Fine-Tune-Adapters with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Andrei-Alex/Fine-Tune-Adapters")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Andrei-Alex/Fine-Tune-Adapters")
model = AutoModelForCausalLM.from_pretrained("Andrei-Alex/Fine-Tune-Adapters", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Andrei-Alex/Fine-Tune-Adapters with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Andrei-Alex/Fine-Tune-Adapters"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Andrei-Alex/Fine-Tune-Adapters",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/Andrei-Alex/Fine-Tune-Adapters

SGLang

How to use Andrei-Alex/Fine-Tune-Adapters with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Andrei-Alex/Fine-Tune-Adapters" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Andrei-Alex/Fine-Tune-Adapters",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Andrei-Alex/Fine-Tune-Adapters" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Andrei-Alex/Fine-Tune-Adapters",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use Andrei-Alex/Fine-Tune-Adapters with Docker Model Runner:
```
docker model run hf.co/Andrei-Alex/Fine-Tune-Adapters
```

Fine-Tune-Adapters

Commit History

update model card README.md

7953ddd

Andrei-Alex commited on Aug 26, 2023

End of training

170b9ef

Andrei-Alex commited on Aug 26, 2023

Training in progress, epoch 0

173d2bc

Andrei-Alex commited on Aug 26, 2023

update model card README.md

b4073b5

Andrei-Alex commited on Aug 26, 2023

End of training

e22b6c3

Andrei-Alex commited on Aug 26, 2023

Training in progress, epoch 0

208c6d3

Andrei-Alex commited on Aug 26, 2023

update model card README.md

1a88a3b

Andrei-Alex commited on Aug 26, 2023

End of training

e0ae0b5

Andrei-Alex commited on Aug 26, 2023

Training in progress, epoch 0

6649c41

Andrei-Alex commited on Aug 26, 2023

update model card README.md

31a819f

Andrei-Alex commited on Aug 26, 2023

End of training

6cb8177

Andrei-Alex commited on Aug 26, 2023

Training in progress, epoch 0

4964aa0

Andrei-Alex commited on Aug 26, 2023

Training in progress, epoch 0

b8e50d5

Andrei-Alex commited on Aug 26, 2023

update model card README.md

a10b904

Andrei-Alex commited on Aug 25, 2023

End of training

cba2125

Andrei-Alex commited on Aug 25, 2023

Training in progress, epoch 0

2de7020

Andrei-Alex commited on Aug 25, 2023

Training in progress, epoch 0

eed775d

Andrei-Alex commited on Aug 25, 2023

Training in progress, epoch 0

fe9a3a3

Andrei-Alex commited on Aug 25, 2023

update model card README.md

4295ff0

Andrei-Alex commited on Aug 24, 2023

End of training

9ae77a0

Andrei-Alex commited on Aug 24, 2023

Training in progress, epoch 0

92d2b3b

Andrei-Alex commited on Aug 24, 2023

Training in progress, epoch 0

1afa04b

Andrei-Alex commited on Aug 24, 2023

Create config.json

3e27c0b

Andrei-Alex commited on Aug 24, 2023

update model card README.md

9b5698b

Andrei-Alex commited on Aug 24, 2023

End of training

e7c63a4

Andrei-Alex commited on Aug 24, 2023

Training in progress, epoch 0

80d528d

Andrei-Alex commited on Aug 24, 2023

initial commit

f9ddd75

Andrei Alexandru commited on Aug 22, 2023

Commit History

update model card README.md 7953ddd

End of training 170b9ef

Training in progress, epoch 0 173d2bc

update model card README.md b4073b5

End of training e22b6c3

Training in progress, epoch 0 208c6d3

update model card README.md 1a88a3b

End of training e0ae0b5

Training in progress, epoch 0 6649c41

update model card README.md 31a819f

End of training 6cb8177

Training in progress, epoch 0 4964aa0

Training in progress, epoch 0 b8e50d5

update model card README.md a10b904

End of training cba2125

Training in progress, epoch 0 2de7020

Training in progress, epoch 0 eed775d

Training in progress, epoch 0 fe9a3a3

update model card README.md 4295ff0

End of training 9ae77a0

Training in progress, epoch 0 92d2b3b

Training in progress, epoch 0 1afa04b

Create config.json 3e27c0b

update model card README.md 9b5698b

End of training e7c63a4

Training in progress, epoch 0 80d528d

initial commit f9ddd75

update model card README.md

7953ddd

End of training

170b9ef

Training in progress, epoch 0

173d2bc

update model card README.md

b4073b5

End of training

e22b6c3

Training in progress, epoch 0

208c6d3

update model card README.md

1a88a3b

End of training

e0ae0b5

Training in progress, epoch 0

6649c41

update model card README.md

31a819f

End of training

6cb8177

Training in progress, epoch 0

4964aa0

Training in progress, epoch 0

b8e50d5

update model card README.md

a10b904

End of training

cba2125

Training in progress, epoch 0

2de7020

Training in progress, epoch 0

eed775d

Training in progress, epoch 0

fe9a3a3

update model card README.md

4295ff0

End of training

9ae77a0

Training in progress, epoch 0

92d2b3b

Training in progress, epoch 0

1afa04b

Create config.json

3e27c0b

update model card README.md

9b5698b

End of training

e7c63a4

Training in progress, epoch 0

80d528d

initial commit

f9ddd75