⚑ W.A.R. β€” Modular Multi-Receptor LLM & Safety Architecture

License: MIT PyTorch Precision Dataset Hardware

🌍 Read this documentation in: English | PortuguΓͺs


🌐 English Documentation

Overview

W.A.R. is an open-source Large Language Model (LLM) and modular verification ecosystem built entirely from scratch in pure PyTorch. Designed and implemented by a 14-year-old independent student researcher from Brazil, the project addresses two of the most critical challenges in modern foundation models β€” adversarial prompt injections and factual hallucinations β€” directly at the architectural level rather than relying on external API wrappers.

The baseline tri-modular pipeline comprises ~1.09B parameters (1 Promoter + 1 Receptor + 1 Judge) and scales up to ~2.92B parameters when instantiated with 5 domain-specialized Receptors via CPU-to-Device dynamic memory swapping.


πŸ—οΈ Architectural Pipeline (Promoter $\rightarrow$ 5x Receptors $\rightarrow$ Judge)

                             [ User Input Prompt ]
                                       β”‚
                                       β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ 1. PROMOTER (~229M Params | Bidirectional Transformer Encoder)              β”‚
β”‚    β€’ Inspects full prompt context (is_causal=False) + Masked Mean Pooling   β”‚
β”‚    β€’ Trained on deepset/prompt-injections (1.0 = Safe, 0.0 = Attack)        β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                                       β”‚
                        If Safe (P >= 0.5) & Routed
                                       β”‚
         β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
         β–Ό                  β–Ό                   β–Ό                  β–Ό
  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”     β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
  β”‚ Receptor #0 β”‚    β”‚ Receptor #1 β”‚ ... β”‚ Receptor #3 β”‚    β”‚ Receptor #4 β”‚
  β”‚ (~457M GPT) β”‚    β”‚ (~457M GPT) β”‚     β”‚ (~457M GPT) β”‚    β”‚ (~457M GPT) β”‚
  β””β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”˜     β””β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”˜
         β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                                       β”‚
                     Candidate Response (Dynamic Device Swap)
                                       β”‚
                                       β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ 3. JUDGE (~407M Params | Bidirectional Hallucination Verifier)              β”‚
β”‚    β€’ Warm-started from pretrained Receptor Embeddings + First 20 Blocks     β”‚
β”‚    β€’ Evaluates (Question + Candidate Answer) on pminervini/HaluEval         β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                                       β”‚
                         If Factual (P >= 0.5)
                                       β–Ό
                            [ Verified Final Output ]
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Datasets used to train FelipeWarOFC/WAR