Update README.md
Browse files
README.md
CHANGED
|
@@ -24,14 +24,14 @@ This model represents the beginning of a deliberate, long-term effort to build A
|
|
| 24 |
|
| 25 |
## Overview
|
| 26 |
|
| 27 |
-
EnigmaCoder 2B is a fine-tuned language model built on **Google Gemma-4-
|
| 28 |
|
| 29 |
Rather than relying entirely on external AI providers, EnigmaCoder is developing its own model stack. EnigmaCoder 2B is the foundation of that effort — a model we own, control, and will continue to develop as part of our broader AI engineering architecture.
|
| 30 |
|
| 31 |
| Property | Value |
|
| 32 |
|---|---|
|
| 33 |
| **Base Model** | google/gemma-4-e2b-it |
|
| 34 |
-
| **Parameters** | ~
|
| 35 |
| **Architecture** | Gemma-4 Transformer |
|
| 36 |
| **Precision** | Float16 |
|
| 37 |
| **Context Window** | 128K tokens |
|
|
@@ -88,7 +88,7 @@ EnigmaCoder 2B is not a prototype. It is the first iteration of an ongoing devel
|
|
| 88 |
|
| 89 |
EnigmaCoder 2B was developed through the following process:
|
| 90 |
|
| 91 |
-
- **Base:** Google Gemma-4-
|
| 92 |
- **Fine-tuning method:** QLoRA with 4-bit quantization during training, merged to full Float16 weights for inference
|
| 93 |
- **Training data:** Curated conversational coding and reasoning data focused on software engineering tasks
|
| 94 |
- **LoRA configuration:** Rank 32, Alpha 64, targeting all linear layers
|
|
@@ -124,7 +124,10 @@ def ask(question):
|
|
| 124 |
repetition_penalty=1.2,
|
| 125 |
pad_token_id=tokenizer.eos_token_id,
|
| 126 |
)
|
| 127 |
-
return tokenizer.decode(
|
|
|
|
|
|
|
|
|
|
| 128 |
|
| 129 |
print(ask("Write a Python function that implements binary search with proper error handling."))
|
| 130 |
```
|
|
@@ -165,7 +168,7 @@ EnigmaCoder 2B is intended for software engineering assistance. Users should:
|
|
| 165 |
|
| 166 |
- Review generated code before deploying it to production
|
| 167 |
- Not rely on the model for security-critical decisions without human verification
|
| 168 |
-
- Be aware that the model may produce incorrect code or reasoning
|
| 169 |
|
| 170 |
This model is subject to the [Gemma Terms of Use](https://ai.google.dev/gemma/terms).
|
| 171 |
|
|
@@ -173,7 +176,7 @@ This model is subject to the [Gemma Terms of Use](https://ai.google.dev/gemma/te
|
|
| 173 |
|
| 174 |
## Acknowledgements and License
|
| 175 |
|
| 176 |
-
EnigmaCoder 2B is built on **Google Gemma-4-
|
| 177 |
|
| 178 |
Training data includes publicly available instruction-following datasets curated for software engineering relevance.
|
| 179 |
|
|
|
|
| 24 |
|
| 25 |
## Overview
|
| 26 |
|
| 27 |
+
EnigmaCoder 2B is a fine-tuned language model built on **Google Gemma-4-E2B-IT**, specialized for software engineering tasks including code generation, explanation, debugging, and reasoning.
|
| 28 |
|
| 29 |
Rather than relying entirely on external AI providers, EnigmaCoder is developing its own model stack. EnigmaCoder 2B is the foundation of that effort — a model we own, control, and will continue to develop as part of our broader AI engineering architecture.
|
| 30 |
|
| 31 |
| Property | Value |
|
| 32 |
|---|---|
|
| 33 |
| **Base Model** | google/gemma-4-e2b-it |
|
| 34 |
+
| **Parameters** | ~2B |
|
| 35 |
| **Architecture** | Gemma-4 Transformer |
|
| 36 |
| **Precision** | Float16 |
|
| 37 |
| **Context Window** | 128K tokens |
|
|
|
|
| 88 |
|
| 89 |
EnigmaCoder 2B was developed through the following process:
|
| 90 |
|
| 91 |
+
- **Base:** Google Gemma-4-E2B-IT — a capable instruction-tuned foundation
|
| 92 |
- **Fine-tuning method:** QLoRA with 4-bit quantization during training, merged to full Float16 weights for inference
|
| 93 |
- **Training data:** Curated conversational coding and reasoning data focused on software engineering tasks
|
| 94 |
- **LoRA configuration:** Rank 32, Alpha 64, targeting all linear layers
|
|
|
|
| 124 |
repetition_penalty=1.2,
|
| 125 |
pad_token_id=tokenizer.eos_token_id,
|
| 126 |
)
|
| 127 |
+
return tokenizer.decode(
|
| 128 |
+
output[0][inputs["input_ids"].shape[1]:],
|
| 129 |
+
skip_special_tokens=True
|
| 130 |
+
)
|
| 131 |
|
| 132 |
print(ask("Write a Python function that implements binary search with proper error handling."))
|
| 133 |
```
|
|
|
|
| 168 |
|
| 169 |
- Review generated code before deploying it to production
|
| 170 |
- Not rely on the model for security-critical decisions without human verification
|
| 171 |
+
- Be aware that the model may produce incorrect code or reasoning on complex or novel problems
|
| 172 |
|
| 173 |
This model is subject to the [Gemma Terms of Use](https://ai.google.dev/gemma/terms).
|
| 174 |
|
|
|
|
| 176 |
|
| 177 |
## Acknowledgements and License
|
| 178 |
|
| 179 |
+
EnigmaCoder 2B is built on **Google Gemma-4-E2B-IT** and is subject to the [Gemma License](https://ai.google.dev/gemma/terms).
|
| 180 |
|
| 181 |
Training data includes publicly available instruction-following datasets curated for software engineering relevance.
|
| 182 |
|