Instructions to use evafiai/eva-lender-matching with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use evafiai/eva-lender-matching with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("evafiai/eva-lender-matching") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use evafiai/eva-lender-matching with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "evafiai/eva-lender-matching" --prompt "Once upon a time"
EVA Lender Matching Model
Fine-tuned Llama 3.2 3B model for SBA lender matching and financial advisory.
Model Description
This model was trained using:
- SFT (Supervised Fine-Tuning): 500 iterations on lender matching data
- DPO (Direct Preference Optimization): 500 iterations for preference alignment
Training Results
| Stage | Initial Loss | Final Loss | Improvement |
|---|---|---|---|
| Val Loss | 2.902 | 0.331 | 88.6% reduction |
| Train Loss | 2.495 | 0.300 | 88.0% reduction |
Usage
from mlx_lm import load, generate
model, tokenizer = load(
"mlx-community/Llama-3.2-3B-Instruct-4bit",
adapter_path="evafiai/eva-lender-matching"
)
prompt = "I need a $500,000 SBA loan for my manufacturing business. What lenders do you recommend?"
response = generate(model, tokenizer, prompt=prompt, max_tokens=300)
print(response)
Capabilities
- SBA 7(a) and 504 loan recommendations
- Lender matching based on business profile
- NAICS code identification
- Industry-specific financing guidance
Training Data
Trained on:
- 7,393 preference pairs for DPO
- Comprehensive lender database with verified contacts
- NAICS code matching examples
License
Apache 2.0
Hardware compatibility
Log In to add your hardware
Quantized
Model tree for evafiai/eva-lender-matching
Base model
meta-llama/Llama-3.2-3B-Instruct Finetuned
mlx-community/Llama-3.2-3B-Instruct Quantized
mlx-community/Llama-3.2-3B-Instruct-4bit