Add README
Browse files
README.md
ADDED
|
@@ -0,0 +1,66 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Diamond Swarm - VA Claims AI Agents
|
| 2 |
+
|
| 3 |
+
Fine-tuned Qwen2.5-7B models specialized for VA disability claims assistance.
|
| 4 |
+
|
| 5 |
+
## Models
|
| 6 |
+
|
| 7 |
+
| Model | Purpose | HuggingFace | GGUF |
|
| 8 |
+
|-------|---------|-------------|------|
|
| 9 |
+
| **Auditor** | Legal analysis, compliance review, document parsing | [Diamond-Swarm-Auditor-7B](https://huggingface.co/Vet-Rate-org/Diamond-Swarm-Auditor-7B) | [GGUF](https://huggingface.co/Vet-Rate-org/Diamond-Swarm-Auditor-7B-GGUF) |
|
| 10 |
+
| **Writer** | Personal statements, nexus letters, buddy statements | [Diamond-Swarm-Writer-7B](https://huggingface.co/Vet-Rate-org/Diamond-Swarm-Writer-7B) | [GGUF](https://huggingface.co/Vet-Rate-org/Diamond-Swarm-Writer-7B-GGUF) |
|
| 11 |
+
| **Rater** | VA rating calculations, bilateral factor, TDIU assessment | [Diamond-Swarm-Rater-7B](https://huggingface.co/Vet-Rate-org/Diamond-Swarm-Rater-7B) | [GGUF](https://huggingface.co/Vet-Rate-org/Diamond-Swarm-Rater-7B-GGUF) |
|
| 12 |
+
|
| 13 |
+
## Base Model
|
| 14 |
+
- **Qwen2.5-7B-Instruct** - Fine-tuned with QLoRA (4-bit)
|
| 15 |
+
|
| 16 |
+
## Training Data
|
| 17 |
+
- 38 CFR Part 4 (VA Rating Schedule)
|
| 18 |
+
- BVA case decisions
|
| 19 |
+
- VA claims procedures and terminology
|
| 20 |
+
- Nexus letter templates
|
| 21 |
+
- Personal statement examples
|
| 22 |
+
|
| 23 |
+
## Usage
|
| 24 |
+
|
| 25 |
+
### HuggingFace Transformers
|
| 26 |
+
```python
|
| 27 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 28 |
+
|
| 29 |
+
model = AutoModelForCausalLM.from_pretrained("Vet-Rate-org/Diamond-Swarm-Auditor-7B")
|
| 30 |
+
tokenizer = AutoTokenizer.from_pretrained("Vet-Rate-org/Diamond-Swarm-Auditor-7B")
|
| 31 |
+
```
|
| 32 |
+
|
| 33 |
+
### llama.cpp
|
| 34 |
+
```bash
|
| 35 |
+
# Download GGUF
|
| 36 |
+
wget https://huggingface.co/Vet-Rate-org/Diamond-Swarm-Auditor-7B-GGUF/resolve/main/vetrate-auditor-7b-v2-Q4_K_M.gguf
|
| 37 |
+
|
| 38 |
+
# Run server
|
| 39 |
+
./llama-server -m vetrate-auditor-7b-v2-Q4_K_M.gguf -c 4096 -ngl 99 --port 8080
|
| 40 |
+
```
|
| 41 |
+
|
| 42 |
+
### Ollama
|
| 43 |
+
```bash
|
| 44 |
+
# Create Modelfile
|
| 45 |
+
FROM ./vetrate-auditor-7b-v2-Q4_K_M.gguf
|
| 46 |
+
PARAMETER temperature 0.7
|
| 47 |
+
SYSTEM You are a VA claims expert specializing in legal analysis.
|
| 48 |
+
|
| 49 |
+
# Create model
|
| 50 |
+
ollama create diamond-auditor -f Modelfile
|
| 51 |
+
ollama run diamond-auditor
|
| 52 |
+
```
|
| 53 |
+
|
| 54 |
+
## GGUF Quantizations
|
| 55 |
+
- **Q4_K_M** (~4.4GB) - Best balance of speed and quality
|
| 56 |
+
- **Q5_K_M** (~5.1GB) - Higher quality, slightly slower
|
| 57 |
+
|
| 58 |
+
## License
|
| 59 |
+
MIT - Free for personal and commercial use
|
| 60 |
+
|
| 61 |
+
## Disclaimer
|
| 62 |
+
These models provide educational information only. They are NOT legal or medical advice. Always consult with accredited VSOs, attorneys, or medical professionals for official guidance.
|
| 63 |
+
|
| 64 |
+
## Credits
|
| 65 |
+
- Built by [Vet-Rate.org](https://vet-rate.org)
|
| 66 |
+
- Powered by [Qwen2.5](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)
|