Ory999 commited on
Commit
454b5c4
·
verified ·
1 Parent(s): a4bf804

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -97,7 +97,7 @@ The Final Model achieves the highest F1 score across all iterations, demonstrati
97
  **QLoRA advantages:**
98
  - Adapts a generative LLM to patent language with only 0.53% of parameters trained
99
  - Enables a domain-aware Judge that understands Y02 classification logic
100
- - 4-bit quantization fits 8B model on a free 16 GB T4 GPU
101
 
102
  **MAS + HITL advantages:**
103
  - Debate structure surfaces disagreements that single-model approaches miss
@@ -107,7 +107,6 @@ The Final Model achieves the highest F1 score across all iterations, demonstrati
107
  **Limitations:**
108
  - DirectML (AMD GPU) not fully supported by sentence-transformers training — fell back to CPU
109
  - torchao 0.16.0 conflicts with transformers lazy loader in certain environments
110
- - LM Studio local inference adds latency (~3–5s per agent call)
111
 
112
 
113
  ## Repository Contents
@@ -120,6 +119,7 @@ The Final Model achieves the highest F1 score across all iterations, demonstrati
120
  | `final_classifier.joblib` | Serialised final Logistic Regression classifier |
121
  | `qlora_outputs.zip` | QLoRA adapter weights (`qlora_green_patent_adapter/`) |
122
  | `Part C Step 1.ipynb` | Colab notebook for QLoRA fine-tuning |
 
123
 
124
 
125
  ## Related Repositories
 
97
  **QLoRA advantages:**
98
  - Adapts a generative LLM to patent language with only 0.53% of parameters trained
99
  - Enables a domain-aware Judge that understands Y02 classification logic
100
+ - 4-bit quantization fits 8B model on a free 15 GB T4 GPU
101
 
102
  **MAS + HITL advantages:**
103
  - Debate structure surfaces disagreements that single-model approaches miss
 
107
  **Limitations:**
108
  - DirectML (AMD GPU) not fully supported by sentence-transformers training — fell back to CPU
109
  - torchao 0.16.0 conflicts with transformers lazy loader in certain environments
 
110
 
111
 
112
  ## Repository Contents
 
119
  | `final_classifier.joblib` | Serialised final Logistic Regression classifier |
120
  | `qlora_outputs.zip` | QLoRA adapter weights (`qlora_green_patent_adapter/`) |
121
  | `Part C Step 1.ipynb` | Colab notebook for QLoRA fine-tuning |
122
+ | `Debate transcripts` | All debate transcrips for MAS |
123
 
124
 
125
  ## Related Repositories