--- license: apache-2.0 library_name: scikit-learn pipeline_tag: tabular-classification tags: - ai-governance - responsible-ai - risk-classification - scikit-learn - synthetic-data datasets: - aigovdev/ai-governance-scenarios --- # Governance Risk Classifier A small experimental baseline for classifying synthetic AI governance scenarios into coarse engineering risk tiers. The model is part of the AIGovDev public AI governance engineering portfolio. ## Model architecture The pipeline uses: - categorical feature preprocessing - one-hot encoding - logistic regression - balanced class weights Input features: - sector - impact - decision autonomy - human oversight - post-deployment monitoring - traceability - technical documentation ## Target labels The original governance labels are mapped into three coarse tiers: - `low` and `limited` → `lower` - `high` → `high` - `unacceptable` → `unacceptable` These labels are engineering annotations only. They are **not legal classifications** and must not be interpreted as determining compliance with the EU AI Act or any other regulation. ## Training data The model is trained on: `aigovdev/ai-governance-scenarios` The current dataset contains 12 synthetic scenarios: - 6 `lower` - 3 `high` - 3 `unacceptable` The scenarios were manually constructed for experimentation and demonstration. They are not production data. ## Evaluation The current prototype uses stratified 3-fold cross-validation. Results: | Metric | Score | | --- | ---: | | Accuracy | 1.000 | | Macro precision | 1.000 | | Macro recall | 1.000 | | Macro F1 | 1.000 | Confusion matrix: lower 6 0 0 high 0 3 0 unacceptable 0 0 3 These results must be interpreted with extreme caution. The dataset contains only 12 synthetic, manually constructed examples. The perfect cross-validation result is therefore primarily evidence that the current feature patterns are easily separable within this toy dataset. It is **not evidence of real-world generalization**, production readiness, regulatory validity, or calibrated governance-risk estimation. ## Intended use This model is suitable for: - educational experiments - AI governance pipeline prototyping - demonstrating transparent tabular ML workflows - testing governance-risk feature engineering - portfolio and research-oriented demonstrations ## Not intended for The model must not be used as: - a legal compliance classifier - an EU AI Act classification system - a production governance decision engine - a substitute for legal or technical risk assessment - a validated risk-scoring system ## Reproducibility The repository contains: - `src/train.py` - `requirements.txt` - `model.joblib` - `metrics.json` The training script downloads the public dataset directly from Hugging Face and reproduces the model pipeline and evaluation. ## Limitations Major limitations include: - extremely small dataset - synthetic scenarios - manually constructed labels - simplified governance dimensions - no external validation set - no calibration analysis - no real deployment data ## Future work Possible extensions include: - larger governance scenario datasets - independently annotated examples - real-world control evidence - lifecycle and incident features - probability calibration - external validation - benchmark comparison - legal-risk separation from engineering-risk signals ## AIGov AIGov builds infrastructure for transparent, auditable, and accountable AI systems. Website: https://govbase.dev ## License Apache-2.0 ## Inference The repository includes `inference.py` for local predictions. Example: ```bash python inference.py --json '{ "sector": "financial_services", "impact": "high", "decision_autonomy": "automated", "human_oversight": "none", "monitoring": "none", "traceability": "none", "technical_documentation": "partial" }' ``` Example output: ```json { "risk_tier": "unacceptable", "class_probabilities": { "high": 0.24612, "lower": 0.08766, "unacceptable": 0.66622 } } ``` The returned class probabilities are model scores from the logistic-regression baseline. They should not be interpreted as calibrated probabilities of legal or real-world governance risk.