Sriram-214 commited on
Commit
1fbe23f
·
verified ·
1 Parent(s): 3604127

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +37 -22
README.md CHANGED
@@ -1,22 +1,37 @@
1
- ---
2
- base_model: unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit
3
- tags:
4
- - text-generation-inference
5
- - transformers
6
- - unsloth
7
- - qwen2
8
- - trl
9
- license: apache-2.0
10
- language:
11
- - en
12
- ---
13
-
14
- # Uploaded model
15
-
16
- - **Developed by:** Sriram-214
17
- - **License:** apache-2.0
18
- - **Finetuned from model :** unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit
19
-
20
- This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth)
21
-
22
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # nodejs-coder-qwen25
2
+
3
+ A fine-tuned **Qwen2.5-Coder-7B** model specialized for Node.js backend development, merged and quantized to GGUF (Q4_K_M) for local inference with Ollama.
4
+
5
+ ## Model Details
6
+ - **Base Model:** `unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit`
7
+ - **Fine-tuning:** LoRA adapters merged into base weights
8
+ - **Format:** GGUF Q4_K_M (~4.4 GB)
9
+ - **Specialties:** Express.js, NestJS, Sequelize, Prisma, MongoDB, PostgreSQL, Jest
10
+
11
+ ## Quick Start with Ollama
12
+
13
+ ```bash
14
+ # 1. Download the GGUF
15
+ hf download Sriram-214/nodejs-coder-qwen25 nodejs-coder-Q4_K_M.gguf --local-dir ./
16
+
17
+ # 2. Download the Modelfile
18
+ hf download Sriram-214/nodejs-coder-qwen25 Modelfile --local-dir ./
19
+
20
+ # 3. Create the Ollama model
21
+ ollama create nodejs-coder -f Modelfile
22
+
23
+ # 4. Run it
24
+ ollama run nodejs-coder
25
+ ```
26
+
27
+ ## Modelfile Configuration
28
+ The included `Modelfile` uses the correct **Qwen2 chat template** with proper stop tokens.
29
+ For GPUs with limited VRAM (≤6GB), `num_gpu 0` forces CPU inference.
30
+
31
+ ## Example Prompts
32
+ ```
33
+ Write a Node.js REST API with Express and JWT authentication
34
+ Create a Mongoose model for a User with name, email and age
35
+ Write a pg query to fetch paginated users with error handling
36
+ Write Jest unit tests for an Express route handler
37
+ ```