Instructions to use WonGrifferousAI/MisTraXLLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use WonGrifferousAI/MisTraXLLM with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="WonGrifferousAI/MisTraXLLM")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("WonGrifferousAI/MisTraXLLM") model = AutoModelForCausalLM.from_pretrained("WonGrifferousAI/MisTraXLLM", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use WonGrifferousAI/MisTraXLLM with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "WonGrifferousAI/MisTraXLLM" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "WonGrifferousAI/MisTraXLLM", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/WonGrifferousAI/MisTraXLLM
- SGLang
How to use WonGrifferousAI/MisTraXLLM with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "WonGrifferousAI/MisTraXLLM" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "WonGrifferousAI/MisTraXLLM", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "WonGrifferousAI/MisTraXLLM" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "WonGrifferousAI/MisTraXLLM", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use WonGrifferousAI/MisTraXLLM with Docker Model Runner:
docker model run hf.co/WonGrifferousAI/MisTraXLLM
Delete autotrain-data
Browse files- autotrain-data/dataset_dict.json +0 -1
- autotrain-data/train/data-00000-of-00006.arrow +0 -3
- autotrain-data/train/data-00001-of-00006.arrow +0 -3
- autotrain-data/train/data-00002-of-00006.arrow +0 -3
- autotrain-data/train/data-00003-of-00006.arrow +0 -3
- autotrain-data/train/data-00004-of-00006.arrow +0 -3
- autotrain-data/train/data-00005-of-00006.arrow +0 -3
- autotrain-data/train/dataset_info.json +0 -12
- autotrain-data/train/state.json +0 -28
- autotrain-data/validation/data-00000-of-00006.arrow +0 -3
- autotrain-data/validation/data-00001-of-00006.arrow +0 -3
- autotrain-data/validation/data-00002-of-00006.arrow +0 -3
- autotrain-data/validation/data-00003-of-00006.arrow +0 -3
- autotrain-data/validation/data-00004-of-00006.arrow +0 -3
- autotrain-data/validation/data-00005-of-00006.arrow +0 -3
- autotrain-data/validation/dataset_info.json +0 -12
- autotrain-data/validation/state.json +0 -28
autotrain-data/dataset_dict.json
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
{"splits": ["train", "validation"]}
|
|
|
|
|
|
autotrain-data/train/data-00000-of-00006.arrow
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:0fcff7033322edc5457a872e7102d5b73008886f82298fd3aa8500e31f0e1898
|
| 3 |
-
size 612540528
|
|
|
|
|
|
|
|
|
|
|
|
autotrain-data/train/data-00001-of-00006.arrow
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:80d97f6a51a5deffb0ddf7c0df4b6305c829b90728e941d263fab64ad33c82db
|
| 3 |
-
size 582202992
|
|
|
|
|
|
|
|
|
|
|
|
autotrain-data/train/data-00002-of-00006.arrow
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:962772a8f12b6f501e35d580958aa39e405034839e107981c2ff0c5af4852a6c
|
| 3 |
-
size 469873904
|
|
|
|
|
|
|
|
|
|
|
|
autotrain-data/train/data-00003-of-00006.arrow
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:22969288efa339ddb93f3b0c96cfa6cd495c71696c4468e4c9adfd13bf7228dd
|
| 3 |
-
size 141271728
|
|
|
|
|
|
|
|
|
|
|
|
autotrain-data/train/data-00004-of-00006.arrow
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:27a151ebc8fb3be6e3969d48d651bfeb648146975ef5be3814f64efe51e6691f
|
| 3 |
-
size 491365808
|
|
|
|
|
|
|
|
|
|
|
|
autotrain-data/train/data-00005-of-00006.arrow
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:e416d92cff19f2e316a49d2bf75471f787dfdcf08d35a1bec581d0dbbdebded3
|
| 3 |
-
size 220452656
|
|
|
|
|
|
|
|
|
|
|
|
autotrain-data/train/dataset_info.json
DELETED
|
@@ -1,12 +0,0 @@
|
|
| 1 |
-
{
|
| 2 |
-
"citation": "",
|
| 3 |
-
"description": "",
|
| 4 |
-
"features": {
|
| 5 |
-
"autotrain_text": {
|
| 6 |
-
"dtype": "string",
|
| 7 |
-
"_type": "Value"
|
| 8 |
-
}
|
| 9 |
-
},
|
| 10 |
-
"homepage": "",
|
| 11 |
-
"license": ""
|
| 12 |
-
}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
autotrain-data/train/state.json
DELETED
|
@@ -1,28 +0,0 @@
|
|
| 1 |
-
{
|
| 2 |
-
"_data_files": [
|
| 3 |
-
{
|
| 4 |
-
"filename": "data-00000-of-00006.arrow"
|
| 5 |
-
},
|
| 6 |
-
{
|
| 7 |
-
"filename": "data-00001-of-00006.arrow"
|
| 8 |
-
},
|
| 9 |
-
{
|
| 10 |
-
"filename": "data-00002-of-00006.arrow"
|
| 11 |
-
},
|
| 12 |
-
{
|
| 13 |
-
"filename": "data-00003-of-00006.arrow"
|
| 14 |
-
},
|
| 15 |
-
{
|
| 16 |
-
"filename": "data-00004-of-00006.arrow"
|
| 17 |
-
},
|
| 18 |
-
{
|
| 19 |
-
"filename": "data-00005-of-00006.arrow"
|
| 20 |
-
}
|
| 21 |
-
],
|
| 22 |
-
"_fingerprint": "92455bc5ac963ada",
|
| 23 |
-
"_format_columns": null,
|
| 24 |
-
"_format_kwargs": {},
|
| 25 |
-
"_format_type": null,
|
| 26 |
-
"_output_all_columns": false,
|
| 27 |
-
"_split": null
|
| 28 |
-
}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
autotrain-data/validation/data-00000-of-00006.arrow
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:0fcff7033322edc5457a872e7102d5b73008886f82298fd3aa8500e31f0e1898
|
| 3 |
-
size 612540528
|
|
|
|
|
|
|
|
|
|
|
|
autotrain-data/validation/data-00001-of-00006.arrow
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:80d97f6a51a5deffb0ddf7c0df4b6305c829b90728e941d263fab64ad33c82db
|
| 3 |
-
size 582202992
|
|
|
|
|
|
|
|
|
|
|
|
autotrain-data/validation/data-00002-of-00006.arrow
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:962772a8f12b6f501e35d580958aa39e405034839e107981c2ff0c5af4852a6c
|
| 3 |
-
size 469873904
|
|
|
|
|
|
|
|
|
|
|
|
autotrain-data/validation/data-00003-of-00006.arrow
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:22969288efa339ddb93f3b0c96cfa6cd495c71696c4468e4c9adfd13bf7228dd
|
| 3 |
-
size 141271728
|
|
|
|
|
|
|
|
|
|
|
|
autotrain-data/validation/data-00004-of-00006.arrow
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:27a151ebc8fb3be6e3969d48d651bfeb648146975ef5be3814f64efe51e6691f
|
| 3 |
-
size 491365808
|
|
|
|
|
|
|
|
|
|
|
|
autotrain-data/validation/data-00005-of-00006.arrow
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:e416d92cff19f2e316a49d2bf75471f787dfdcf08d35a1bec581d0dbbdebded3
|
| 3 |
-
size 220452656
|
|
|
|
|
|
|
|
|
|
|
|
autotrain-data/validation/dataset_info.json
DELETED
|
@@ -1,12 +0,0 @@
|
|
| 1 |
-
{
|
| 2 |
-
"citation": "",
|
| 3 |
-
"description": "",
|
| 4 |
-
"features": {
|
| 5 |
-
"autotrain_text": {
|
| 6 |
-
"dtype": "string",
|
| 7 |
-
"_type": "Value"
|
| 8 |
-
}
|
| 9 |
-
},
|
| 10 |
-
"homepage": "",
|
| 11 |
-
"license": ""
|
| 12 |
-
}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
autotrain-data/validation/state.json
DELETED
|
@@ -1,28 +0,0 @@
|
|
| 1 |
-
{
|
| 2 |
-
"_data_files": [
|
| 3 |
-
{
|
| 4 |
-
"filename": "data-00000-of-00006.arrow"
|
| 5 |
-
},
|
| 6 |
-
{
|
| 7 |
-
"filename": "data-00001-of-00006.arrow"
|
| 8 |
-
},
|
| 9 |
-
{
|
| 10 |
-
"filename": "data-00002-of-00006.arrow"
|
| 11 |
-
},
|
| 12 |
-
{
|
| 13 |
-
"filename": "data-00003-of-00006.arrow"
|
| 14 |
-
},
|
| 15 |
-
{
|
| 16 |
-
"filename": "data-00004-of-00006.arrow"
|
| 17 |
-
},
|
| 18 |
-
{
|
| 19 |
-
"filename": "data-00005-of-00006.arrow"
|
| 20 |
-
}
|
| 21 |
-
],
|
| 22 |
-
"_fingerprint": "92455bc5ac963ada",
|
| 23 |
-
"_format_columns": null,
|
| 24 |
-
"_format_kwargs": {},
|
| 25 |
-
"_format_type": null,
|
| 26 |
-
"_output_all_columns": false,
|
| 27 |
-
"_split": null
|
| 28 |
-
}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|