Instructions to use typeof/OpenHermes-2.5-Mistral-7B-exploded with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use typeof/OpenHermes-2.5-Mistral-7B-exploded with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="typeof/OpenHermes-2.5-Mistral-7B-exploded")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("typeof/OpenHermes-2.5-Mistral-7B-exploded")
model = AutoModelForCausalLM.from_pretrained("typeof/OpenHermes-2.5-Mistral-7B-exploded", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use typeof/OpenHermes-2.5-Mistral-7B-exploded with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "typeof/OpenHermes-2.5-Mistral-7B-exploded"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "typeof/OpenHermes-2.5-Mistral-7B-exploded",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/typeof/OpenHermes-2.5-Mistral-7B-exploded

SGLang

How to use typeof/OpenHermes-2.5-Mistral-7B-exploded with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "typeof/OpenHermes-2.5-Mistral-7B-exploded" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "typeof/OpenHermes-2.5-Mistral-7B-exploded",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "typeof/OpenHermes-2.5-Mistral-7B-exploded" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "typeof/OpenHermes-2.5-Mistral-7B-exploded",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use typeof/OpenHermes-2.5-Mistral-7B-exploded with Docker Model Runner:
```
docker model run hf.co/typeof/OpenHermes-2.5-Mistral-7B-exploded
```

typeof commited on Nov 21, 2023

Commit

d1135c4

1 Parent(s): 5403746

init

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

model-00001-of-00291.safetensors +3 -0
model-00002-of-00291.safetensors +3 -0
model-00003-of-00291.safetensors +3 -0
model-00004-of-00291.safetensors +3 -0
model-00005-of-00291.safetensors +3 -0
model-00006-of-00291.safetensors +3 -0
model-00007-of-00291.safetensors +3 -0
model-00008-of-00291.safetensors +3 -0
model-00009-of-00291.safetensors +3 -0
model-00010-of-00291.safetensors +3 -0
model-00011-of-00291.safetensors +3 -0
model-00012-of-00291.safetensors +3 -0
model-00013-of-00291.safetensors +3 -0
model-00014-of-00291.safetensors +3 -0
model-00015-of-00291.safetensors +3 -0
model-00016-of-00291.safetensors +3 -0
model-00017-of-00291.safetensors +3 -0
model-00018-of-00291.safetensors +3 -0
model-00019-of-00291.safetensors +3 -0
model-00020-of-00291.safetensors +3 -0
model-00021-of-00291.safetensors +3 -0
model-00022-of-00291.safetensors +3 -0
model-00023-of-00291.safetensors +3 -0
model-00024-of-00291.safetensors +3 -0
model-00025-of-00291.safetensors +3 -0
model-00026-of-00291.safetensors +3 -0
model-00027-of-00291.safetensors +3 -0
model-00028-of-00291.safetensors +3 -0
model-00029-of-00291.safetensors +3 -0
model-00030-of-00291.safetensors +3 -0
model-00031-of-00291.safetensors +3 -0
model-00032-of-00291.safetensors +3 -0
model-00033-of-00291.safetensors +3 -0
model-00034-of-00291.safetensors +3 -0
model-00035-of-00291.safetensors +3 -0
model-00036-of-00291.safetensors +3 -0
model-00037-of-00291.safetensors +3 -0
model-00038-of-00291.safetensors +3 -0
model-00039-of-00291.safetensors +3 -0
model-00040-of-00291.safetensors +3 -0
model-00041-of-00291.safetensors +3 -0
model-00042-of-00291.safetensors +3 -0
model-00043-of-00291.safetensors +3 -0
model-00044-of-00291.safetensors +3 -0
model-00045-of-00291.safetensors +3 -0
model-00046-of-00291.safetensors +3 -0
model-00047-of-00291.safetensors +3 -0
model-00048-of-00291.safetensors +3 -0
model-00049-of-00291.safetensors +3 -0
model-00050-of-00291.safetensors +3 -0

model-00001-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:be2b961d0cd9887df12b196137836146a10baffcc4583fe9fa0ec34366a01d5a
+size 262160520

model-00002-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e6bb5788fe12267a3e95af014f487a02b1b3b023a97f16aa4991468994af0b81
+size 8328

model-00003-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b8980321f6b98801dd00b2a1f256e24a446fcaaaea5cd83334d4e784d2eb8358
+size 117440664

model-00004-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0cee71d83fbd7541807ff1d72e678e2bbce671813ad4274c451337bf91963069
+size 117440664

model-00005-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8dbf8c01e284b3d3382bdcc3e1e7f44a02f3491f1974c7b6ce1d0aeab4047636
+size 117440656

model-00006-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:94a51e9586116c2b212f4d51a47d7e11aa695b4c5d25dff632c78ba45ad7dd2c
+size 8344

model-00007-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5a70d2a9dc7f11f7d2a8c6e4b237b35aee26276db0544961abe14d433669a1fc
+size 8388760

model-00008-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:12a26ac708a9c85671e68a00648e2a085002b14030c7895e5c89e37b4b18c159
+size 33554584

model-00009-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:504be6cc74d7eddc03482d9d4b0320342973d834daca3f4be727a979f3905e5d
+size 33554584

model-00010-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1417ddd9e43d0af52b58d50eb7702f0e2a84cc2cab9e276c5d73245a80524ff2
+size 8388760

model-00011-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3d38997d3ca7a23aba7b6bfa19780bcf590544ad8c6e4edec1177c6884ef5e56
+size 8328

model-00012-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f6be3030ca4498b24f292582da0ad09209453a01a834937c905d365e7f1add03
+size 117440664

model-00013-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:15620a26955d70a2ba8ddd2752163feac55eff44a15cdc58f6588af48e399e22
+size 117440664

model-00014-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7131717b00802b2f3c9a19fdd6ddb0a501dfb0490e4f4fcf157f6c3b891f652e
+size 117440656

model-00015-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d3eee6ca48621e20aa994d4bdaf6e503b600e9de1cdb47cce6b14a5eb97cbb02
+size 8344

model-00016-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c17931936147dbe6ef9f5abfb8732d23e00f53446fbd293cc41c877c42696521
+size 8388760

model-00017-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:111d91188c74b1c5591398616032f546679e740381b4bdc9c76b8f706d9c7849
+size 33554584

model-00018-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2384517229e2d5bd46314e649bb258c58b096577b6a2dd8cb4ba565478833325
+size 33554584

model-00019-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9ed7fe9db25cb21690f6e9a85e3fc595d096e4c35fa0dd16f4a22427ea606fb1
+size 8388760

model-00020-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fba539c9de80798573b99bb5ff68f610437b496bef611ad98e0babe3629f37b6
+size 8328

model-00021-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8b427b8b1ae1c7ca131c20045248d764180106ae9886905822af8a67fb037790
+size 117440664

model-00022-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:86c48671a5dec5b8d73d3640492fc818adf64ef0d022396af751eae412fe6aed
+size 117440664

model-00023-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a3b89baf1e0bd4154cb001c564b07e771d4816833c09e85a5db621cee92c3bb2
+size 117440656

model-00024-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0c23dae4ca17fe7bd7494eeb11a82f58b057dc231a138929eb3c376a4a6c12ef
+size 8344

model-00025-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:31bc56b2c1efc003f7995452d73e42622b64dd98689a378802cd2d99f33645b7
+size 8388760

model-00026-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0938ce93bcf47d0e2a518bb9ee3a46f0df75974fe06a8a539767b4fda7624415
+size 33554584

model-00027-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8ca192c479fb2b90553862837404357707f55cc6333eebd475d35a50790bc6f3
+size 33554584

model-00028-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8cbddd3f6aaf66b6cc18e9e17b9d6e147951c3de170d8d871e0a176cfd3bf846
+size 8388760

model-00029-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e06e457191e8f955b9cd30700975804e4fc7bdf260f78a467e5114b04c41f2f6
+size 117440664

model-00030-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:933b62a656ccb3f9b11c3342fc0aa64fedbe9f686f508e95e07dbc77ab57bc81
+size 117440656

model-00031-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:521375594ba8a377d0650494b0b26c4e52c8249e4f67c3caad7bfd15dccf94d5
+size 8388760

model-00032-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:91ffd9223d55495d799bdebad13a20c83744a32e0cd224783335564477645f22
+size 33554584

model-00033-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ce86bcde872f940a66fab544fb0c3141af7533914b6dca84c06183410e123806
+size 33554584

model-00034-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8894ec441e5c2e6d10cacd357fc0ac9f1a28d0c4ef6a5b5b14765222c00c9195
+size 8388760

model-00035-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:10f7acb1bdeb11860972b1f6a3322437ae7071ab92b32cf927a02ce03fd80e8f
+size 8328

model-00036-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:341112867ff4770a932050a3adff01d2ddce4829ea322839540d14f25fd02fd0
+size 117440664

model-00037-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a990112059e46c0aee59e73c7c07b624830b52a8fb1e45b41d8abd8d234658b9
+size 8344

model-00038-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1f2a88bf2d2de15cb43ff025d3af4929f0ecfcba14a32f07d8e00378b78b322e
+size 8328

model-00039-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cf0728daebfb6d0160d88e70abcd21f80c66bb29938ffb731faf0bf4b2e76cc1
+size 117440664

model-00040-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:175c0694a5f9e91bc0d46eec769208c43c6656b4010a699eb8f8992ee0f820a7
+size 117440664

model-00041-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fb66a6633419c81880d07f94d4a66964bd6b6f506b6f4ba896a361b023162623
+size 117440656

model-00042-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7e33df14396176859a82129d2a629025d8fc611c2a32a12da7ebbf5ebb8f5585
+size 8344

model-00043-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:421e67279e88e703be7c78178d9a8821be3542eaaf030c7c9421867311629090
+size 8388760

model-00044-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7b984c21111f245f55b07320e43a0beff04fcb64417c306966a7e7b7b0972756
+size 33554584

model-00045-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ae966ec995b7f182419b2dae07abc01eefe1a1f81c0cfd6e8a70b43507d9f9f2
+size 33554584

model-00046-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:17bb8fee2c8a8f3e9c99b8ad361bb14f6dbd3f74484ee03826306c8e9748822f
+size 8388760

model-00047-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:18945b41daaa853d97921a555df9db4ea64fa6fad8acda2dfb28fa22ad78b63b
+size 8328

model-00048-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:36d58826455b186462932b685b0988df1d7a44c731052e2f2f209c02e6e8d416
+size 117440664

model-00049-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f570e41ea1b7a7ea72cc212017d9aa79225935d069eb3e40bfa64a6c22556654
+size 117440664

model-00050-of-00291.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:290bb964914c44579d28fbb84b0c3f80345b859a9135d2853dde70073f212435
+size 117440656