Instructions to use euclaise/falcon_1b_stage3_2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use euclaise/falcon_1b_stage3_2 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="euclaise/falcon_1b_stage3_2", trust_remote_code=True)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("euclaise/falcon_1b_stage3_2", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("euclaise/falcon_1b_stage3_2", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use euclaise/falcon_1b_stage3_2 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "euclaise/falcon_1b_stage3_2"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "euclaise/falcon_1b_stage3_2",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/euclaise/falcon_1b_stage3_2

SGLang

How to use euclaise/falcon_1b_stage3_2 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "euclaise/falcon_1b_stage3_2" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "euclaise/falcon_1b_stage3_2",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "euclaise/falcon_1b_stage3_2" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "euclaise/falcon_1b_stage3_2",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use euclaise/falcon_1b_stage3_2 with Docker Model Runner:
```
docker model run hf.co/euclaise/falcon_1b_stage3_2
```

falcon_1b_stage3_2

Commit History

Adding Evaluation Results

8a9ae7d

leaderboard-pr-bot commited on Nov 17, 2023

End of training

aec2f59

euclaise commited on Sep 25, 2023

Training in progress, epoch 4

2b6c4ac

euclaise commited on Sep 25, 2023

Training in progress, epoch 3

fc4d33b

euclaise commited on Sep 25, 2023

Training in progress, epoch 2

87200d1

euclaise commited on Sep 25, 2023

Training in progress, epoch 1

efbc36c

euclaise commited on Sep 25, 2023

Training in progress, epoch 0

d40a9e5

euclaise commited on Sep 25, 2023

End of training

59526d2

euclaise commited on Sep 24, 2023

Training in progress, epoch 4

9cac244

euclaise commited on Sep 24, 2023

Training in progress, epoch 3

a627635

euclaise commited on Sep 24, 2023

Training in progress, epoch 2

bf5daad

euclaise commited on Sep 24, 2023

Training in progress, epoch 1

9f09bae

euclaise commited on Sep 24, 2023

Training in progress, epoch 0

39da507

euclaise commited on Sep 24, 2023

Training in progress, epoch 0

958d1bc

euclaise commited on Sep 23, 2023

Training in progress, epoch 1

655f963

euclaise commited on Sep 23, 2023

Training in progress, epoch 0

835f1d3

euclaise commited on Sep 23, 2023

initial commit

e95781d

Josh/Jade Pritsker commited on Sep 23, 2023

Commit History

Adding Evaluation Results 8a9ae7d

End of training aec2f59

Training in progress, epoch 4 2b6c4ac

Training in progress, epoch 3 fc4d33b

Training in progress, epoch 2 87200d1

Training in progress, epoch 1 efbc36c

Training in progress, epoch 0 d40a9e5

End of training 59526d2

Training in progress, epoch 4 9cac244

Training in progress, epoch 3 a627635

Training in progress, epoch 2 bf5daad

Training in progress, epoch 1 9f09bae

Training in progress, epoch 0 39da507

Training in progress, epoch 0 958d1bc

Training in progress, epoch 1 655f963

Training in progress, epoch 0 835f1d3

initial commit e95781d

Adding Evaluation Results

8a9ae7d

End of training

aec2f59

Training in progress, epoch 4

2b6c4ac

Training in progress, epoch 3

fc4d33b

Training in progress, epoch 2

87200d1

Training in progress, epoch 1

efbc36c

Training in progress, epoch 0

d40a9e5

End of training

59526d2

Training in progress, epoch 4

9cac244

Training in progress, epoch 3

a627635

Training in progress, epoch 2

bf5daad

Training in progress, epoch 1

9f09bae

Training in progress, epoch 0

39da507

Training in progress, epoch 0

958d1bc

Training in progress, epoch 1

655f963

Training in progress, epoch 0

835f1d3

initial commit

e95781d