Update README.md
Browse files
README.md
CHANGED
|
@@ -97,7 +97,7 @@ The Final Model achieves the highest F1 score across all iterations, demonstrati
|
|
| 97 |
**QLoRA advantages:**
|
| 98 |
- Adapts a generative LLM to patent language with only 0.53% of parameters trained
|
| 99 |
- Enables a domain-aware Judge that understands Y02 classification logic
|
| 100 |
-
- 4-bit quantization fits 8B model on a free
|
| 101 |
|
| 102 |
**MAS + HITL advantages:**
|
| 103 |
- Debate structure surfaces disagreements that single-model approaches miss
|
|
@@ -107,7 +107,6 @@ The Final Model achieves the highest F1 score across all iterations, demonstrati
|
|
| 107 |
**Limitations:**
|
| 108 |
- DirectML (AMD GPU) not fully supported by sentence-transformers training — fell back to CPU
|
| 109 |
- torchao 0.16.0 conflicts with transformers lazy loader in certain environments
|
| 110 |
-
- LM Studio local inference adds latency (~3–5s per agent call)
|
| 111 |
|
| 112 |
|
| 113 |
## Repository Contents
|
|
@@ -120,6 +119,7 @@ The Final Model achieves the highest F1 score across all iterations, demonstrati
|
|
| 120 |
| `final_classifier.joblib` | Serialised final Logistic Regression classifier |
|
| 121 |
| `qlora_outputs.zip` | QLoRA adapter weights (`qlora_green_patent_adapter/`) |
|
| 122 |
| `Part C Step 1.ipynb` | Colab notebook for QLoRA fine-tuning |
|
|
|
|
| 123 |
|
| 124 |
|
| 125 |
## Related Repositories
|
|
|
|
| 97 |
**QLoRA advantages:**
|
| 98 |
- Adapts a generative LLM to patent language with only 0.53% of parameters trained
|
| 99 |
- Enables a domain-aware Judge that understands Y02 classification logic
|
| 100 |
+
- 4-bit quantization fits 8B model on a free 15 GB T4 GPU
|
| 101 |
|
| 102 |
**MAS + HITL advantages:**
|
| 103 |
- Debate structure surfaces disagreements that single-model approaches miss
|
|
|
|
| 107 |
**Limitations:**
|
| 108 |
- DirectML (AMD GPU) not fully supported by sentence-transformers training — fell back to CPU
|
| 109 |
- torchao 0.16.0 conflicts with transformers lazy loader in certain environments
|
|
|
|
| 110 |
|
| 111 |
|
| 112 |
## Repository Contents
|
|
|
|
| 119 |
| `final_classifier.joblib` | Serialised final Logistic Regression classifier |
|
| 120 |
| `qlora_outputs.zip` | QLoRA adapter weights (`qlora_green_patent_adapter/`) |
|
| 121 |
| `Part C Step 1.ipynb` | Colab notebook for QLoRA fine-tuning |
|
| 122 |
+
| `Debate transcripts` | All debate transcrips for MAS |
|
| 123 |
|
| 124 |
|
| 125 |
## Related Repositories
|