Instructions to use KnowledgeXLab/MemHarness with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use KnowledgeXLab/MemHarness with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="KnowledgeXLab/MemHarness")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("KnowledgeXLab/MemHarness", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use KnowledgeXLab/MemHarness with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "KnowledgeXLab/MemHarness" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "KnowledgeXLab/MemHarness", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/KnowledgeXLab/MemHarness
- SGLang
How to use KnowledgeXLab/MemHarness with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "KnowledgeXLab/MemHarness" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "KnowledgeXLab/MemHarness", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "KnowledgeXLab/MemHarness" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "KnowledgeXLab/MemHarness", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use KnowledgeXLab/MemHarness with Docker Model Runner:
docker model run hf.co/KnowledgeXLab/MemHarness
Add files using upload-large-folder tool
Browse files- alfworld-7b/model-00001-of-00007.safetensors +3 -0
- alfworld-7b/model-00003-of-00007.safetensors +3 -0
- alfworld-7b/model-00004-of-00007.safetensors +3 -0
- alfworld-7b/model-00005-of-00007.safetensors +3 -0
- alfworld-7b/model-00007-of-00007.safetensors +3 -0
- cold_start/alfworld/model-00003-of-00007.safetensors +3 -0
- cold_start/alfworld/model-00004-of-00007.safetensors +3 -0
- cold_start/webshop/model-00001-of-00007.safetensors +3 -0
- cold_start/webshop/model-00002-of-00007.safetensors +3 -0
- cold_start/webshop/model-00003-of-00007.safetensors +3 -0
- cold_start/webshop/model-00004-of-00007.safetensors +3 -0
- cold_start/webshop/model-00005-of-00007.safetensors +3 -0
- webshop-7b/model-00001-of-00007.safetensors +3 -0
- webshop-7b/model-00003-of-00007.safetensors +3 -0
- webshop-7b/model-00004-of-00007.safetensors +3 -0
- webshop-7b/model-00005-of-00007.safetensors +3 -0
- webshop-7b/model-00007-of-00007.safetensors +3 -0
alfworld-7b/model-00001-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5f55b91b9856136148c13ac792486bb7c7b5e41c48f29dfc17142b90a7fca36b
|
| 3 |
+
size 4976687216
|
alfworld-7b/model-00003-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d63c9cf607ca9f6366d3c8c99a16d2fd188b2c8abc418d9288c9fd1d549af5ed
|
| 3 |
+
size 4932743960
|
alfworld-7b/model-00004-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5881c75462dc2e8408b6095cddbab445188a0dea4034e0c53dcb258cbff0110e
|
| 3 |
+
size 4932743992
|
alfworld-7b/model-00005-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dae719099ee8a236389050d4f79862b1b5949c951784c76e96593a810a8398c6
|
| 3 |
+
size 4998852296
|
alfworld-7b/model-00007-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8baf7b1c4419ae0f93759b03106f7edb410812b13cc69593c420d923f6353eab
|
| 3 |
+
size 2179989632
|
cold_start/alfworld/model-00003-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bb6a14495b5ce48d4a2c494595ade26570eb0ac266ccab482eea42eb639d4370
|
| 3 |
+
size 4932743960
|
cold_start/alfworld/model-00004-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b220aabb542a863d18ec09344af26dd5ad69a6da9e976de9df2232d4a72ddf48
|
| 3 |
+
size 4932743992
|
cold_start/webshop/model-00001-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4740f2a9c6a9d485018937d8aff47392ab6b1112177e30bdffd4e5d453bdc9a9
|
| 3 |
+
size 4976687216
|
cold_start/webshop/model-00002-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:352c1888d7db263d2820b08f95f51dc535dab2fa4e6a64e20f18f7cd1689e6af
|
| 3 |
+
size 4778622352
|
cold_start/webshop/model-00003-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ddf2b96f4df274ee64ec991e96ee591e2adb1526c1a245200909ff690f09fedb
|
| 3 |
+
size 4932743960
|
cold_start/webshop/model-00004-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4f4b4245d864b58a1048fd55e9bd478f6608c3d3af1e21b075918f045bcbcf72
|
| 3 |
+
size 4932743992
|
cold_start/webshop/model-00005-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:eda6f7504ec549d7845138fa3cd854328d3ecd6b8e7f112d79a21c9ecd3e1c25
|
| 3 |
+
size 4998852296
|
webshop-7b/model-00001-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2b80a751fcc450cff4a0fe4d3b2bf9b590cac028acf5a422acf9b5b878c22719
|
| 3 |
+
size 4976687216
|
webshop-7b/model-00003-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3e9086f84608867fadbe093cc6c231bd8dcdbbbdc296447318c846b3d0db9070
|
| 3 |
+
size 4932743960
|
webshop-7b/model-00004-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bc2e221a5ab08c0a19a1f21c0970f6e94adcff71c7dcc0d57f3b481d179f4d03
|
| 3 |
+
size 4932743992
|
webshop-7b/model-00005-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dc21ad37a8fcfaaddd99336664c1cc5d40fc2246f5a122c3ad26765622d5f6ba
|
| 3 |
+
size 4998852296
|
webshop-7b/model-00007-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:443466de23cf71f90711e04891d6c7e9bc9c2bb6d66b241fc170a2c7e44ca1b5
|
| 3 |
+
size 2179989632
|