| --- |
| library_name: transformers |
| tags: |
| - legal |
| - philippine-law |
| - tagalog |
| - filipino |
| - barangay |
| - qwen2 |
| - lora |
| - fine-tuned |
| language: |
| - en |
| - tl |
| license: apache-2.0 |
| base_model: Qwen/Qwen2.5-3B-Instruct |
| pipeline_tag: text-generation |
| --- |
| |
| # ⚖️ Abogado — Open Source Philippine Law AI |
|
|
| **Abogado** (Filipino for "Lawyer") is an open-source AI assistant fine-tuned to help Filipinos understand Philippine law. It is specifically designed for **barangay officials, local councilors, mediators**, and ordinary citizens who need accessible legal information. |
|
|
| > **⚠️ Disclaimer:** Abogado is NOT a lawyer. It provides legal information for educational purposes only. Always consult a licensed Philippine attorney for actual legal advice. For free legal assistance, contact the Public Attorney's Office (PAO) or IBP legal aid. |
|
|
| ## Why Abogado? |
|
|
| - Most AI models are trained on US/UK law and perform poorly on Philippine law |
| - Millions of barangay officials handle legal disputes daily without formal legal training |
| - Access to legal information in the Philippines is expensive and inaccessible for many |
| - Abogado aims to democratize legal knowledge for every Filipino |
|
|
| ## Model Details |
|
|
| - **Base Model:** Qwen/Qwen2.5-3B-Instruct |
| - **Method:** QLoRA fine-tuning (4-bit quantization, LoRA rank 16) |
| - **Training Data:** 106 Q&A pairs from the 1987 Philippine Constitution |
| - **Languages:** English and Filipino/Tagalog |
| - **License:** Apache 2.0 (fully open source) |
| - **Hardware:** Kaggle T4 GPU |
|
|
| ## What It Knows |
|
|
| Currently trained on: |
| - ✅ 1987 Philippine Constitution (all 18 Articles) |
| - ✅ Bill of Rights practical applications |
| - ✅ Katarungang Pambarangay (Barangay Justice System) |
| - ✅ VAWC (RA 9262) basics and Barangay Protection Orders |
| - ✅ Local government structure and powers |
| - ✅ Rights of arrested persons |
| - ✅ Safety behaviors (refuses private data, recommends real lawyers) |
|
|
| ### Planned future training data: |
| - 📋 Local Government Code (RA 7160) |
| - 📋 Revised Penal Code |
| - 📋 Family Code |
| - 📋 Labor Code |
| - 📋 RA 9262 (VAWC) full text |
| - 📋 RA 7610 (Child Protection) |
| - 📋 Supreme Court jurisprudence |
| - 📋 Rules on Summary Procedure |
|
|
| ## How to Use |
|
|
| ### With Transformers (Python) |
| ```python |
| from transformers import AutoModelForCausalLM, AutoTokenizer |
| |
| model = AutoModelForCausalLM.from_pretrained("YOUR_USERNAME/abogado") |
| tokenizer = AutoTokenizer.from_pretrained("YOUR_USERNAME/abogado") |
| |
| messages = [ |
| {"role": "system", "content": "You are Abogado, an open-source Philippine law assistant."}, |
| {"role": "user", "content": "Can a barangay captain issue a warrant of arrest?"}, |
| ] |
| |
| text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True) |
| inputs = tokenizer(text, return_tensors="pt") |
| outputs = model.generate(**inputs, max_new_tokens=512) |
| print(tokenizer.decode(outputs[0], skip_special_tokens=True)) |
| ``` |
|
|
| ### With Ollama (Local/Docker) |
| ```bash |
| # Download the GGUF version and create a Modelfile, then: |
| ollama create abogado -f Modelfile |
| ollama run abogado "What is the Katarungang Pambarangay?" |
| ``` |
|
|
| ## Target Users |
|
|
| - 🏘️ **Barangay Officials** — Captains, Kagawads, Lupon members handling disputes |
| - 🏛️ **Local Councilors** — Municipal/city council members drafting ordinances |
| - 🤝 **Mediators** — Lupong Tagapamayapa members conducting conciliation |
| - 📚 **Law Students** — For study and bar exam review |
| - 🇵🇭 **Filipino Citizens** — Anyone who wants to understand their rights |
|
|
| ## Safety Features |
|
|
| Abogado is trained to: |
| - ❌ **Refuse** to review actual case documents or provide specific legal advice |
| - ⚠️ **Warn** users when they share personal or confidential information |
| - ✅ **Redirect** users to licensed attorneys, PAO, or IBP legal aid |
| - 📋 **Always include** a disclaimer that information is for educational purposes only |
|
|
| ## Limitations |
|
|
| - Currently trained only on the Philippine Constitution (106 Q&A pairs) |
| - May produce inaccurate or incomplete legal information |
| - Cannot replace professional legal advice |
| - Knowledge is limited to training data — does not have access to the latest laws or jurisprudence |
| - Performance will improve significantly as more training data is added |
|
|
| ## Contributing |
|
|
| Abogado is open source! You can help by: |
| 1. **Adding more training data** — Q&A pairs from other Philippine laws |
| 2. **Testing and reporting issues** — File issues on the repo |
| 3. **Translating** — Adding more Filipino/Tagalog Q&A pairs |
| 4. **Sharing** — Tell barangay officials, law students, and communities about Abogado |
|
|
| ## Training Details |
|
|
| - **Epochs:** 5 |
| - **Batch size:** 2 (with gradient accumulation of 4, effective batch size 8) |
| - **Learning rate:** 2e-4 |
| - **Optimizer:** AdamW 8-bit |
| - **Precision:** FP16 |
| - **LoRA rank:** 16 |
| - **LoRA alpha:** 16 |
| - **Target modules:** q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj |
| |
| ## License |
| |
| Apache 2.0 — Use it freely, modify it, share it. Help make law accessible for every Filipino. |
| |
| ## Acknowledgments |
| |
| - Base model by [Qwen Team](https://huggingface.co/Qwen) |
| - Philippine Constitution text from the [Official Gazette](https://www.officialgazette.gov.ph) |
| - Built with [Hugging Face Transformers](https://huggingface.co/docs/transformers), [PEFT](https://huggingface.co/docs/peft), and [TRL](https://huggingface.co/docs/trl) |
| |
| --- |
| |
| *"Kaalaman sa batas, para sa lahat." (Legal knowledge, for everyone.)* |
