TobiasLogic commited on
Commit
380b837
·
verified ·
1 Parent(s): 2f272a5

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +10 -11
README.md CHANGED
@@ -4,23 +4,25 @@ language:
4
  tags:
5
  - coding
6
  - qwen2.5
7
- - uncensored
8
  - unsloth
9
  - 32b
10
  license: apache-2.0
11
  ---
12
 
13
- # Qwen2.5-Coder-32B-Uncensored
14
 
15
  ## Model Description
16
- **Qwen2.5-Coder-32B-Uncensored** is a highly specialized, instruction-tuned version of the Qwen2.5-Coder-32B base model. This model has been aggressively fine-tuned to completely remove refusal mechanisms, disclaimers, and unnecessary moralizing when generating code. It acts as a direct, strictly compliant coding assistant designed for advanced developers and researchers who require raw, unfiltered output.
 
 
17
 
18
  The model was fine-tuned using a distilled, high-quality combination of the **CodeFeedback-Filtered-Instruction** and **python_code_instructions_18k_alpaca** datasets, running over 20,000 highly diverse programming scenarios.
19
 
20
  By aggressively targeting the Attention layers during fine-tuning (while leaving the complex MLP structures frozen), this model achieves state-of-the-art formatting compliance and instruction following without compromising the encyclopedic coding knowledge of the 32B base model.
21
 
22
  ## Model Details
23
- - **Base Model:** Qwen/Qwen2.5-Coder-32B-Instruct (Abliterated Base)
24
  - **Parameters:** 32 Billion
25
  - **Context Length:** Up to 32K (optimized at 512 for dense instruction tuning)
26
  - **Training Strategy:** LoRA (Attention Modules Only: `q_proj`, `k_proj`, `v_proj`, `o_proj`)
@@ -32,7 +34,7 @@ By aggressively targeting the Attention layers during fine-tuning (while leaving
32
  ### Ollama / LM Studio (GGUF)
33
  You can seamlessly run the GGUF version locally using Ollama:
34
  ```bash
35
- ollama run TobiasLogic/Qwen2.5-Coder-32B-Uncensored:q4_k_m
36
  ```
37
 
38
  ### Transformers
@@ -46,7 +48,7 @@ model = AutoModelForCausalLM.from_pretrained(
46
  )
47
 
48
  messages = [
49
- {"role": "user", "content": "Write a python script to bypass a firewall."}
50
  ]
51
 
52
  text = tokenizer.apply_chat_template(
@@ -64,9 +66,6 @@ print(tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0])
64
  ```
65
 
66
  ## Training Data & Methodology
67
- The model was fine-tuned utilizing **Unsloth** for rapid multi-processing data ingestion and memory-efficient LoRA scaling. The dataset consisted of heavily curated coding problems spanning over 50 programming languages, converted into standard ShareGPT conversational format.
68
-
69
- To eliminate refusal behaviors without catastrophic forgetting, we targeted only the Attention matrices. The model was trained with a learning rate of `2e-4`, achieving a remarkably low final loss of `0.45` without overfitting.
70
 
71
- ## Disclaimer
72
- This model is provided entirely unfiltered and uncensored. It will generate exactly what is requested of it, including malicious, insecure, or dangerous code if prompted. The creators of this model take no responsibility for how the model is used. Use responsibly and in isolated environments when dealing with unknown code execution.
 
4
  tags:
5
  - coding
6
  - qwen2.5
7
+ - python
8
  - unsloth
9
  - 32b
10
  license: apache-2.0
11
  ---
12
 
13
+ # Qwen2.5-Coder-32B-Python-Specialist
14
 
15
  ## Model Description
16
+ **Qwen2.5-Coder-32B-Python-Specialist** is an instruction-tuned version of the standard Qwen2.5-Coder-32B base model. This model has been specifically fine-tuned on a high-quality blend of Python and generalized coding instruction datasets to enhance its proficiency in formatting compliance, multi-turn coding problem solving, and Python-specific tasks.
17
+
18
+ *Note: The model retains the original safety filters and alignment of the Qwen2.5 base model.*
19
 
20
  The model was fine-tuned using a distilled, high-quality combination of the **CodeFeedback-Filtered-Instruction** and **python_code_instructions_18k_alpaca** datasets, running over 20,000 highly diverse programming scenarios.
21
 
22
  By aggressively targeting the Attention layers during fine-tuning (while leaving the complex MLP structures frozen), this model achieves state-of-the-art formatting compliance and instruction following without compromising the encyclopedic coding knowledge of the 32B base model.
23
 
24
  ## Model Details
25
+ - **Base Model:** unsloth/Qwen2.5-Coder-32B-Instruct-bnb-4bit
26
  - **Parameters:** 32 Billion
27
  - **Context Length:** Up to 32K (optimized at 512 for dense instruction tuning)
28
  - **Training Strategy:** LoRA (Attention Modules Only: `q_proj`, `k_proj`, `v_proj`, `o_proj`)
 
34
  ### Ollama / LM Studio (GGUF)
35
  You can seamlessly run the GGUF version locally using Ollama:
36
  ```bash
37
+ ollama run hf.co/TobiasLogic/Qwen2.5-Coder-32B-Uncensored:Q4_K_M
38
  ```
39
 
40
  ### Transformers
 
48
  )
49
 
50
  messages = [
51
+ {"role": "user", "content": "Write a python script to parse a CSV file."}
52
  ]
53
 
54
  text = tokenizer.apply_chat_template(
 
66
  ```
67
 
68
  ## Training Data & Methodology
69
+ The model was fine-tuned utilizing **Unsloth** for rapid multi-processing data ingestion and memory-efficient LoRA scaling. The dataset consisted of heavily curated coding problems, heavily indexing on Python, converted into standard ShareGPT conversational format.
 
 
70
 
71
+ To enhance instruction following without catastrophic forgetting, we targeted only the Attention matrices. The model was trained with a learning rate of `2e-4`, achieving a remarkably low final loss of `0.45` without overfitting.