--- base_model: meta-llama/Llama-3.3-70B-Instruct language: - en license: apache-2.0 library_name: peft pipeline_tag: text-generation tags: - lora - qlora - sft - peft - transformers - trl - forensics - law-enforcement - investigative-ai --- # ABBY — Artifact, Ballistic, and Binary Yield > *"I use my powers for good, not evil."* > — Abby Sciuto, *NCIS* **An open-source LoRA adapter fine-tuned for law enforcement forensic investigators.** ABBY is a QLoRA adapter trained on top of [Meta Llama 3.3 70B Instruct](https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct), specialized for forensic analysis, evidence interpretation, ballistic assessment, digital artifact examination, and investigative reasoning. --- ## Model Details | Field | Value | |---|---| | **Base Model** | [meta-llama/Llama-3.3-70B-Instruct](https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct) | | **Adapter Type** | LoRA (QLoRA, 4-bit NF4) | | **LoRA Rank** | 64 | | **Task** | Forensic investigation, evidence analysis, investigative reasoning | | **Training Method** | QLoRA fine-tuning via SFTTrainer (trl) | | **License** | Apache 2.0 | | **Maintainer** | [Ronin48LLC](https://huggingface.co/Ronin48LLC) | --- ## Intended Use ABBY is designed to assist **certified forensic examiners, law enforcement investigators, and legal professionals** with: - **Digital forensics** — artifact recovery, file system analysis, metadata examination - **Ballistic analysis** — wound pattern assessment, trajectory reconstruction - **Binary/malware analysis** — code review, threat identification - **Chain of custody guidance** — evidence handling best practices - **Investigative reasoning** — connecting evidence to conclusions **This model is intended for professional use in authorized law enforcement and forensic contexts only.** --- ## Usage This is a PEFT LoRA adapter. Load it on top of the base model: ```python from peft import PeftModel from transformers import AutoModelForCausalLM, AutoTokenizer base_model = AutoModelForCausalLM.from_pretrained( "meta-llama/Llama-3.3-70B-Instruct", load_in_4bit=True, device_map="auto", ) model = PeftModel.from_pretrained(base_model, "Ronin48LLC/abby-lora-adapter") tokenizer = AutoTokenizer.from_pretrained("meta-llama/Llama-3.3-70B-Instruct") ``` > **Note:** Access to the base model requires accepting Meta's license on HuggingFace. --- ## Training - **Framework:** PyTorch 2.4 + Transformers + TRL + PEFT - **Quantization:** 4-bit NF4 (bitsandbytes) - **Hardware:** NVIDIA A100 PCIe 80GB - **Training steps:** 78 - **Sequence length:** 4096 --- ## Supporters ABBY is community-funded. Every contribution keeps this project free and in the hands of investigators who need it. | Donor | Amount | Note | |---|---|---| | Ronin 48, LLC | N/A | Founding donor | | Anonymous | $50 | Thank you, Joe Sixpack | *Want to support ABBY? Reach out to the maintainers.* --- ## Related Projects | Project | Description | |---|---| | [SELMA](https://codeberg.org/Ronin48/SELMA) | Criminal law and statute analysis | | [ATTICUS](https://codeberg.org/Ronin48/ATTICUS) | Legal defense reasoning | | [BONES](https://codeberg.org/Ronin48/BONES) | Forensic pathology and osteology | | [BRUNO](https://codeberg.org/Ronin48/BRUNO) | Field operations and tactical support | --- ## License Fine-tuned adapter weights are licensed under **Apache 2.0**. Base model weights are subject to the [Meta Llama 3.1 Community License](https://llama.meta.com/llama3/license/).