Text Generation
Transformers
Safetensors
qwen2
llama-factory
full
Generated from Trainer
conversational
text-generation-inference
Instructions to use lemonhat/Qwen2.5-Coder-7B-Instruct-swe-xml with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use lemonhat/Qwen2.5-Coder-7B-Instruct-swe-xml with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="lemonhat/Qwen2.5-Coder-7B-Instruct-swe-xml") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("lemonhat/Qwen2.5-Coder-7B-Instruct-swe-xml") model = AutoModelForCausalLM.from_pretrained("lemonhat/Qwen2.5-Coder-7B-Instruct-swe-xml") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use lemonhat/Qwen2.5-Coder-7B-Instruct-swe-xml with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "lemonhat/Qwen2.5-Coder-7B-Instruct-swe-xml" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "lemonhat/Qwen2.5-Coder-7B-Instruct-swe-xml", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/lemonhat/Qwen2.5-Coder-7B-Instruct-swe-xml
- SGLang
How to use lemonhat/Qwen2.5-Coder-7B-Instruct-swe-xml with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "lemonhat/Qwen2.5-Coder-7B-Instruct-swe-xml" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "lemonhat/Qwen2.5-Coder-7B-Instruct-swe-xml", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "lemonhat/Qwen2.5-Coder-7B-Instruct-swe-xml" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "lemonhat/Qwen2.5-Coder-7B-Instruct-swe-xml", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use lemonhat/Qwen2.5-Coder-7B-Instruct-swe-xml with Docker Model Runner:
docker model run hf.co/lemonhat/Qwen2.5-Coder-7B-Instruct-swe-xml
Add files using upload-large-folder tool
Browse files- .gitattributes +5 -0
- checkpoint-2000/merges.txt +0 -0
- checkpoint-2000/model-00001-of-00004.safetensors +3 -0
- checkpoint-2000/model-00002-of-00004.safetensors +3 -0
- checkpoint-2000/model-00003-of-00004.safetensors +3 -0
- checkpoint-2000/model-00004-of-00004.safetensors +3 -0
- checkpoint-2000/tokenizer.json +3 -0
- checkpoint-2000/training_args.bin +3 -0
- checkpoint-4000/model-00001-of-00004.safetensors +3 -0
- checkpoint-4000/model-00002-of-00004.safetensors +3 -0
- checkpoint-4000/model-00003-of-00004.safetensors +3 -0
- checkpoint-4000/model-00004-of-00004.safetensors +3 -0
- checkpoint-4000/tokenizer.json +3 -0
- checkpoint-4000/training_args.bin +3 -0
- checkpoint-6000/model-00001-of-00004.safetensors +3 -0
- checkpoint-6000/model-00002-of-00004.safetensors +3 -0
- checkpoint-6000/model-00003-of-00004.safetensors +3 -0
- checkpoint-6000/model-00004-of-00004.safetensors +3 -0
- checkpoint-6000/tokenizer.json +3 -0
- checkpoint-6000/training_args.bin +3 -0
- checkpoint-6000/vocab.json +0 -0
- checkpoint-6430/model-00001-of-00004.safetensors +3 -0
- checkpoint-6430/model-00002-of-00004.safetensors +3 -0
- checkpoint-6430/model-00003-of-00004.safetensors +3 -0
- checkpoint-6430/model-00004-of-00004.safetensors +3 -0
- checkpoint-6430/tokenizer.json +3 -0
- checkpoint-6430/training_args.bin +3 -0
- model-00001-of-00004.safetensors +3 -0
- model-00002-of-00004.safetensors +3 -0
- model-00003-of-00004.safetensors +3 -0
- model-00004-of-00004.safetensors +3 -0
- tokenizer.json +3 -0
- training_args.bin +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
checkpoint-4000/tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
checkpoint-6000/tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
checkpoint-6430/tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
checkpoint-2000/tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
| 40 |
+
tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
checkpoint-2000/merges.txt
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
checkpoint-2000/model-00001-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:378a3bd3b2c026141e7c88dbdcdadf086c3a69b3f482d8772bc6a10f7ef79306
|
| 3 |
+
size 4877660776
|
checkpoint-2000/model-00002-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:91541a77073c3282c71387f3510f377058bda43ee90bb8b016b5455aa8cf43dc
|
| 3 |
+
size 4932751008
|
checkpoint-2000/model-00003-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5712ae1967efb5de8763bd9314454799736f1d4fd058a97444e3dad8190e6322
|
| 3 |
+
size 4330865200
|
checkpoint-2000/model-00004-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c3366714965c68f924858db9f3cfdcb8b1a91245cfcf2f8e56e7ee08eda7d2b7
|
| 3 |
+
size 1089994880
|
checkpoint-2000/tokenizer.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
|
| 3 |
+
size 11421896
|
checkpoint-2000/training_args.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a4a38ba65a55329c97c03eb553cdc60945f38f584a57702a0dfb3596f5ee9f65
|
| 3 |
+
size 7160
|
checkpoint-4000/model-00001-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7592da0c530ec78a1948da88312234fa36a86eb5368ec75b8b527e2e16ff4026
|
| 3 |
+
size 4877660776
|
checkpoint-4000/model-00002-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b9c694b458a6cf54064909b80f307f53f6d8af6284e9ed6c91ebb862560691c9
|
| 3 |
+
size 4932751008
|
checkpoint-4000/model-00003-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d4fcb4657d0f6cfe5585b0bc7cbd8198249d2cc8587e5d47330162d842727bcb
|
| 3 |
+
size 4330865200
|
checkpoint-4000/model-00004-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bb25355cb208fec06190d673d896a115805f4a67256be7884079a629025b3ab2
|
| 3 |
+
size 1089994880
|
checkpoint-4000/tokenizer.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
|
| 3 |
+
size 11421896
|
checkpoint-4000/training_args.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a4a38ba65a55329c97c03eb553cdc60945f38f584a57702a0dfb3596f5ee9f65
|
| 3 |
+
size 7160
|
checkpoint-6000/model-00001-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:acdc4040fbc4806e75ff8522a0958a4c32bad303cb905e05b9d58c2bc88c83d2
|
| 3 |
+
size 4877660776
|
checkpoint-6000/model-00002-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:33c0bdc2cadbf22e5c9adbcf117083fba49468c8c80574aa18929dd3c24bf591
|
| 3 |
+
size 4932751008
|
checkpoint-6000/model-00003-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ec5a20a84f2d3c821e5ece42e86ba7ab36be1497f2062bdcab61943b03a2223a
|
| 3 |
+
size 4330865200
|
checkpoint-6000/model-00004-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7d5c2d2d97f5298cb20eeb0b54de2d7b64589b5385e42b4943080781e1c40d77
|
| 3 |
+
size 1089994880
|
checkpoint-6000/tokenizer.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
|
| 3 |
+
size 11421896
|
checkpoint-6000/training_args.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a4a38ba65a55329c97c03eb553cdc60945f38f584a57702a0dfb3596f5ee9f65
|
| 3 |
+
size 7160
|
checkpoint-6000/vocab.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
checkpoint-6430/model-00001-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0ed91f49186734a2c3f23a798bea6421822b5e9a88a2e088df0063a13dbc2cdb
|
| 3 |
+
size 4877660776
|
checkpoint-6430/model-00002-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c693822297a01242dd3628f009946153d437fd435f0d5493c1d26e830c4e86c4
|
| 3 |
+
size 4932751008
|
checkpoint-6430/model-00003-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2a1edad5a0ae49c1f345889865e516154f346ad155ceeb3f4ff9cf38aece8e80
|
| 3 |
+
size 4330865200
|
checkpoint-6430/model-00004-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:071ea62d953d32d8a2dfce2e23a1f7b102cb880e5c8a8f13385dc3c376bf1471
|
| 3 |
+
size 1089994880
|
checkpoint-6430/tokenizer.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
|
| 3 |
+
size 11421896
|
checkpoint-6430/training_args.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a4a38ba65a55329c97c03eb553cdc60945f38f584a57702a0dfb3596f5ee9f65
|
| 3 |
+
size 7160
|
model-00001-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0ed91f49186734a2c3f23a798bea6421822b5e9a88a2e088df0063a13dbc2cdb
|
| 3 |
+
size 4877660776
|
model-00002-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c693822297a01242dd3628f009946153d437fd435f0d5493c1d26e830c4e86c4
|
| 3 |
+
size 4932751008
|
model-00003-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2a1edad5a0ae49c1f345889865e516154f346ad155ceeb3f4ff9cf38aece8e80
|
| 3 |
+
size 4330865200
|
model-00004-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:071ea62d953d32d8a2dfce2e23a1f7b102cb880e5c8a8f13385dc3c376bf1471
|
| 3 |
+
size 1089994880
|
tokenizer.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
|
| 3 |
+
size 11421896
|
training_args.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a4a38ba65a55329c97c03eb553cdc60945f38f584a57702a0dfb3596f5ee9f65
|
| 3 |
+
size 7160
|