abdulrehmanazizkhan commited on
Commit
2430236
·
verified ·
1 Parent(s): 2bbdc85

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -6
README.md CHANGED
@@ -24,14 +24,14 @@ This model represents the beginning of a deliberate, long-term effort to build A
24
 
25
  ## Overview
26
 
27
- EnigmaCoder 2B is a fine-tuned language model built on **Google Gemma-4-2B-IT**, specialized for software engineering tasks including code generation, explanation, debugging, and reasoning.
28
 
29
  Rather than relying entirely on external AI providers, EnigmaCoder is developing its own model stack. EnigmaCoder 2B is the foundation of that effort — a model we own, control, and will continue to develop as part of our broader AI engineering architecture.
30
 
31
  | Property | Value |
32
  |---|---|
33
  | **Base Model** | google/gemma-4-e2b-it |
34
- | **Parameters** | ~5B |
35
  | **Architecture** | Gemma-4 Transformer |
36
  | **Precision** | Float16 |
37
  | **Context Window** | 128K tokens |
@@ -88,7 +88,7 @@ EnigmaCoder 2B is not a prototype. It is the first iteration of an ongoing devel
88
 
89
  EnigmaCoder 2B was developed through the following process:
90
 
91
- - **Base:** Google Gemma-4-2B-IT — a capable instruction-tuned foundation
92
  - **Fine-tuning method:** QLoRA with 4-bit quantization during training, merged to full Float16 weights for inference
93
  - **Training data:** Curated conversational coding and reasoning data focused on software engineering tasks
94
  - **LoRA configuration:** Rank 32, Alpha 64, targeting all linear layers
@@ -124,7 +124,10 @@ def ask(question):
124
  repetition_penalty=1.2,
125
  pad_token_id=tokenizer.eos_token_id,
126
  )
127
- return tokenizer.decode(output[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True)
 
 
 
128
 
129
  print(ask("Write a Python function that implements binary search with proper error handling."))
130
  ```
@@ -165,7 +168,7 @@ EnigmaCoder 2B is intended for software engineering assistance. Users should:
165
 
166
  - Review generated code before deploying it to production
167
  - Not rely on the model for security-critical decisions without human verification
168
- - Be aware that the model may produce incorrect code or reasoning, particularly on complex or novel problems
169
 
170
  This model is subject to the [Gemma Terms of Use](https://ai.google.dev/gemma/terms).
171
 
@@ -173,7 +176,7 @@ This model is subject to the [Gemma Terms of Use](https://ai.google.dev/gemma/te
173
 
174
  ## Acknowledgements and License
175
 
176
- EnigmaCoder 2B is built on **Google Gemma-4-2B-IT** and is subject to the [Gemma License](https://ai.google.dev/gemma/terms).
177
 
178
  Training data includes publicly available instruction-following datasets curated for software engineering relevance.
179
 
 
24
 
25
  ## Overview
26
 
27
+ EnigmaCoder 2B is a fine-tuned language model built on **Google Gemma-4-E2B-IT**, specialized for software engineering tasks including code generation, explanation, debugging, and reasoning.
28
 
29
  Rather than relying entirely on external AI providers, EnigmaCoder is developing its own model stack. EnigmaCoder 2B is the foundation of that effort — a model we own, control, and will continue to develop as part of our broader AI engineering architecture.
30
 
31
  | Property | Value |
32
  |---|---|
33
  | **Base Model** | google/gemma-4-e2b-it |
34
+ | **Parameters** | ~2B |
35
  | **Architecture** | Gemma-4 Transformer |
36
  | **Precision** | Float16 |
37
  | **Context Window** | 128K tokens |
 
88
 
89
  EnigmaCoder 2B was developed through the following process:
90
 
91
+ - **Base:** Google Gemma-4-E2B-IT — a capable instruction-tuned foundation
92
  - **Fine-tuning method:** QLoRA with 4-bit quantization during training, merged to full Float16 weights for inference
93
  - **Training data:** Curated conversational coding and reasoning data focused on software engineering tasks
94
  - **LoRA configuration:** Rank 32, Alpha 64, targeting all linear layers
 
124
  repetition_penalty=1.2,
125
  pad_token_id=tokenizer.eos_token_id,
126
  )
127
+ return tokenizer.decode(
128
+ output[0][inputs["input_ids"].shape[1]:],
129
+ skip_special_tokens=True
130
+ )
131
 
132
  print(ask("Write a Python function that implements binary search with proper error handling."))
133
  ```
 
168
 
169
  - Review generated code before deploying it to production
170
  - Not rely on the model for security-critical decisions without human verification
171
+ - Be aware that the model may produce incorrect code or reasoning on complex or novel problems
172
 
173
  This model is subject to the [Gemma Terms of Use](https://ai.google.dev/gemma/terms).
174
 
 
176
 
177
  ## Acknowledgements and License
178
 
179
+ EnigmaCoder 2B is built on **Google Gemma-4-E2B-IT** and is subject to the [Gemma License](https://ai.google.dev/gemma/terms).
180
 
181
  Training data includes publicly available instruction-following datasets curated for software engineering relevance.
182