Text Generation
Transformers
Safetensors
qwen2
mergekit
Merge
conversational
text-generation-inference
Instructions to use AlexCuadron/openhands-corrected with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use AlexCuadron/openhands-corrected with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="AlexCuadron/openhands-corrected") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("AlexCuadron/openhands-corrected") model = AutoModelForCausalLM.from_pretrained("AlexCuadron/openhands-corrected", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use AlexCuadron/openhands-corrected with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "AlexCuadron/openhands-corrected" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AlexCuadron/openhands-corrected", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/AlexCuadron/openhands-corrected
- SGLang
How to use AlexCuadron/openhands-corrected with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "AlexCuadron/openhands-corrected" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AlexCuadron/openhands-corrected", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "AlexCuadron/openhands-corrected" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AlexCuadron/openhands-corrected", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use AlexCuadron/openhands-corrected with Docker Model Runner:
docker model run hf.co/AlexCuadron/openhands-corrected
Upload folder using huggingface_hub
Browse files- README.md +2 -2
- mergekit_config.yml +2 -2
- model-00001-of-00014.safetensors +1 -1
- model-00002-of-00014.safetensors +1 -1
- model-00003-of-00014.safetensors +1 -1
- model-00004-of-00014.safetensors +1 -1
- model-00005-of-00014.safetensors +1 -1
- model-00006-of-00014.safetensors +1 -1
- model-00007-of-00014.safetensors +1 -1
- model-00008-of-00014.safetensors +1 -1
- model-00009-of-00014.safetensors +1 -1
- model-00010-of-00014.safetensors +1 -1
- model-00011-of-00014.safetensors +1 -1
- model-00012-of-00014.safetensors +1 -1
- model-00013-of-00014.safetensors +1 -1
- model-00014-of-00014.safetensors +1 -1
README.md
CHANGED
|
@@ -31,10 +31,10 @@ The following YAML configuration was used to produce this model:
|
|
| 31 |
models:
|
| 32 |
- model: all-hands/openhands-lm-32b-v0.1
|
| 33 |
parameters:
|
| 34 |
-
weight:
|
| 35 |
- model: all-hands/openhands-lm-32b-v0.1-ep3
|
| 36 |
parameters:
|
| 37 |
-
weight: 0.
|
| 38 |
merge_method: linear
|
| 39 |
dtype: float16
|
| 40 |
|
|
|
|
| 31 |
models:
|
| 32 |
- model: all-hands/openhands-lm-32b-v0.1
|
| 33 |
parameters:
|
| 34 |
+
weight: 0.5
|
| 35 |
- model: all-hands/openhands-lm-32b-v0.1-ep3
|
| 36 |
parameters:
|
| 37 |
+
weight: 0.5
|
| 38 |
merge_method: linear
|
| 39 |
dtype: float16
|
| 40 |
|
mergekit_config.yml
CHANGED
|
@@ -1,9 +1,9 @@
|
|
| 1 |
models:
|
| 2 |
- model: all-hands/openhands-lm-32b-v0.1
|
| 3 |
parameters:
|
| 4 |
-
weight:
|
| 5 |
- model: all-hands/openhands-lm-32b-v0.1-ep3
|
| 6 |
parameters:
|
| 7 |
-
weight: 0.
|
| 8 |
merge_method: linear
|
| 9 |
dtype: float16
|
|
|
|
| 1 |
models:
|
| 2 |
- model: all-hands/openhands-lm-32b-v0.1
|
| 3 |
parameters:
|
| 4 |
+
weight: 0.5
|
| 5 |
- model: all-hands/openhands-lm-32b-v0.1-ep3
|
| 6 |
parameters:
|
| 7 |
+
weight: 0.5
|
| 8 |
merge_method: linear
|
| 9 |
dtype: float16
|
model-00001-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4949338448
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0d568cb8ccad77e3428c49622bc7b817be8341868fc02cc244c71702d79634b5
|
| 3 |
size 4949338448
|
model-00002-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4991425912
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7537c99a2ce64c7325aabf50a149a84a88a7467798f68969b56adb56a649e0ea
|
| 3 |
size 4991425912
|
model-00003-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059352
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e2ffcf35de64474d4373c1bfb96abe85d24a289d5458b2d466518b5fa0c0cc08
|
| 3 |
size 4876059352
|
model-00004-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059336
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bf74cec42d4c8f2630c70879975a59d1e4c727428b022a0371ec4fc184861fc0
|
| 3 |
size 4876059336
|
model-00005-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059352
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1323e3a6ba742b6ee06eee28f536d6498677e741bcc599e0ffa6ea4a4703374f
|
| 3 |
size 4876059352
|
model-00006-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059336
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9bb4d5e58c49e2cad23e4accdb2c51155a06cd93e050ff298a9c6f0a46e79ab3
|
| 3 |
size 4876059336
|
model-00007-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059352
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d967135f1ce31a115b192226a420800228952f2f870343104a87d33cfa74791d
|
| 3 |
size 4876059352
|
model-00008-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059336
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5233ec586259d9173a59d7880cd7b7e6e9f22b9eb06897efe84bf3bc321c3771
|
| 3 |
size 4876059336
|
model-00009-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059352
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cede474b9335f1c870e4e1d2899193466a0e85a95642bc12d0fdf87de76a409a
|
| 3 |
size 4876059352
|
model-00010-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059336
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:621e97c725e17175e02c32805b86c8f83671d6a75b132ba44ec70b2747b26cea
|
| 3 |
size 4876059336
|
model-00011-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059352
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:10625adaafd26ad799d51fd6c120a8424e6e1f4cab2901d55a10f8b63a35714f
|
| 3 |
size 4876059352
|
model-00012-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059336
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c750adf36277a9a6aab26a5cd778a78c31e32583469bf3d1549afcb6450dfc9d
|
| 3 |
size 4876059336
|
model-00013-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059336
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4c0860ebbc27498eaaac8385d202509298ae4f92b8eed3cbe0758693f34509fa
|
| 3 |
size 4876059336
|
model-00014-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1950423704
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:333071ed2ab448f5e071a5577a6282121a7b576d9455a450fe5f14a259b2469a
|
| 3 |
size 1950423704
|