Text Generation
Transformers
PyTorch
TensorBoard
English
kairos
diffusion
multimodal
Mixture of Experts
trust_remote_code
custom_code
Instructions to use ffurfaro/kairos with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ffurfaro/kairos with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="ffurfaro/kairos", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ffurfaro/kairos", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use ffurfaro/kairos with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "ffurfaro/kairos" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ffurfaro/kairos", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/ffurfaro/kairos
- SGLang
How to use ffurfaro/kairos with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "ffurfaro/kairos" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ffurfaro/kairos", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "ffurfaro/kairos" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ffurfaro/kairos", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use ffurfaro/kairos with Docker Model Runner:
docker model run hf.co/ffurfaro/kairos
Upload folder using huggingface_hub
Browse files- checkpoints/best.pt +3 -0
- checkpoints/step_000200.pt +3 -0
- checkpoints/step_000400.pt +3 -0
- checkpoints/step_000600.pt +3 -0
- checkpoints/step_000800.pt +3 -0
- checkpoints/step_001000.pt +3 -0
- checkpoints/step_001200.pt +3 -0
- checkpoints/step_001400.pt +3 -0
- checkpoints/step_001600.pt +3 -0
- checkpoints/step_001800.pt +3 -0
- checkpoints/step_002000.pt +3 -0
- checkpoints/step_002200.pt +3 -0
- checkpoints/step_002400.pt +3 -0
- checkpoints/step_002600.pt +3 -0
- checkpoints/step_002800.pt +3 -0
- checkpoints/step_003000.pt +3 -0
- checkpoints/step_003200.pt +3 -0
- checkpoints/step_003400.pt +3 -0
- checkpoints/step_003600.pt +3 -0
- checkpoints/step_003800.pt +3 -0
- checkpoints/step_004000.pt +3 -0
- checkpoints/step_004200.pt +3 -0
- checkpoints/step_004400.pt +3 -0
checkpoints/best.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dc136056ff67fc86930f0b9c1c2dc6c655dc244d8cc02d84481c9091c226f6bf
|
| 3 |
+
size 175352581
|
checkpoints/step_000200.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6207ea3c71ec93397c98830aca0fd6d95ae14962e159bfee9b511e06974fbcd8
|
| 3 |
+
size 175436271
|
checkpoints/step_000400.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c6567cb83ccabc40dc7585b59254b7752b0e78ffac29381fd9e54b7f2badec26
|
| 3 |
+
size 175436271
|
checkpoints/step_000600.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f8b5a53cb1c6c7219f33035c98bd3d682fffa8355f62d14113b4bb695f1c5218
|
| 3 |
+
size 175436271
|
checkpoints/step_000800.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5f7208a0cce38cc2faa462caa8903e30bd0d936cf850fb462068a69fc05ea3c5
|
| 3 |
+
size 175436271
|
checkpoints/step_001000.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8eec3c8197a4d50b206c348c2b6b24737ec0f2c904af1542a92cfd5de5c76d23
|
| 3 |
+
size 175436271
|
checkpoints/step_001200.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:edb5b4ed59b8e56555002559fdf2cb8e5f77ae5aa7e5a9638826c0fdb705ccdd
|
| 3 |
+
size 175436271
|
checkpoints/step_001400.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:95eea4343a72b1fd61fd90502f409166ab43655ced31964f2147ff96f04ed4dc
|
| 3 |
+
size 175436271
|
checkpoints/step_001600.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c02f5f033763dbe9ed2cdc1f85022c5161d635da4204cde8806e853aa873bfc0
|
| 3 |
+
size 175436271
|
checkpoints/step_001800.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:809831a8a37a40cd47cf5ceb32e31b8cf5b7cbf38ea10701faba0b0153c9243a
|
| 3 |
+
size 175436271
|
checkpoints/step_002000.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1dec671240eeaeaa3c32eb6cc5914b3ae3249e1d1147d0ba5593073fcd8d8c2a
|
| 3 |
+
size 175436271
|
checkpoints/step_002200.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:89eadbc9c7631845869f611313560a956f0ba48b8cac2034accc738ada6994fc
|
| 3 |
+
size 175436271
|
checkpoints/step_002400.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:04149329aef474b0cd090a378a938331fee00aac845dc16707e44a00cd10f94a
|
| 3 |
+
size 175436271
|
checkpoints/step_002600.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a0ed71bee09376b4ee495c68c8af6b8bfc592ef45c71b0c344bbe0a2d0ed54d4
|
| 3 |
+
size 175436271
|
checkpoints/step_002800.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0fe6381c7f7d3e46743cd11dac76cd294974f6cfc3c1d4fd8e21e82845db82a4
|
| 3 |
+
size 175436271
|
checkpoints/step_003000.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8f6fa226fa671a3df4495bf4d807cd4af67eb5bf1fa60baa81744cf15013138b
|
| 3 |
+
size 175436271
|
checkpoints/step_003200.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:428328afdb5c9638d81f9beb5ef84590d21dd4355ca44e199d3e2998b2a6adb5
|
| 3 |
+
size 175436271
|
checkpoints/step_003400.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a2471a734ad1365ea4004b932d8dfd7653bded1724f165d9f5a38fdceff3c304
|
| 3 |
+
size 175436271
|
checkpoints/step_003600.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c223a28828a69ec915518874cd1d7b0fbb20690382feefea3ac44ef41d44ef42
|
| 3 |
+
size 175436271
|
checkpoints/step_003800.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:03a27b6a8f47f295cad65931553f3425b606245e4fa341470cc24e33b346bcd2
|
| 3 |
+
size 175436271
|
checkpoints/step_004000.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f29d9e79c4fa07acfbc94a296c8b50a85a6f48ccff37f3ef586ccfdcccc3c9e5
|
| 3 |
+
size 175436271
|
checkpoints/step_004200.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8531a591fcf4edfcab6ff3d08c02fa6ac2799d5d5adfa2641e1806a3f2c141ca
|
| 3 |
+
size 175436271
|
checkpoints/step_004400.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5898deb6360fa684587162296033af0220de737f3eaca11d3c8f1f6bd2562a48
|
| 3 |
+
size 175436271
|