Upload folder using huggingface_hub
Browse files- learning/README.md +81 -0
- learning/agents/agents.json +7 -0
- learning/config.json +41 -0
- learning/learning/learning_curve.json +13 -0
- learning/learning/self_improvement.json +11 -0
- learning/memory/learning_state.json +9 -0
learning/README.md
ADDED
|
@@ -0,0 +1,81 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
license: mit
|
| 5 |
+
tags:
|
| 6 |
+
- agent
|
| 7 |
+
- multi-agent
|
| 8 |
+
- autonomous
|
| 9 |
+
- self-improving
|
| 10 |
+
- recursive
|
| 11 |
+
- learn-from-scratch
|
| 12 |
+
- huggingface
|
| 13 |
+
pipeline_tag: text-generation
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
# Agron — Self-Improving Multi-Agent AI
|
| 17 |
+
|
| 18 |
+
**Agron** is an autonomous, self-improving AI agent system that **learns from scratch**.
|
| 19 |
+
It starts with empty memory and bootstrap rules, then recursively improves through:
|
| 20 |
+
|
| 21 |
+
1. Observation of task outcomes
|
| 22 |
+
2. Memory consolidation and knowledge graph growth
|
| 23 |
+
3. Tool/strategy evolution and validation
|
| 24 |
+
4. Safe self-modification with tests
|
| 25 |
+
5. Optional synchronization to Hugging Face
|
| 26 |
+
|
| 27 |
+
## Agent Team
|
| 28 |
+
|
| 29 |
+
| Agent | Role | Specialty |
|
| 30 |
+
|---|---|---|
|
| 31 |
+
| Coordinator | Orchestrator | Decomposes work, delegates, synthesizes |
|
| 32 |
+
| Learner | Knowledge | Ingests, distills, updates memory from scratch |
|
| 33 |
+
| Builder | Improvement | Generates new tools/strategies recursively |
|
| 34 |
+
| Guardian | Safety | Validates changes, prevents regressions |
|
| 35 |
+
|
| 36 |
+
## Learn From Scratch
|
| 37 |
+
|
| 38 |
+
Agron begins with:
|
| 39 |
+
- Empty episodic memory
|
| 40 |
+
- No imported knowledge
|
| 41 |
+
- Seed evaluation rules only
|
| 42 |
+
- Bootstrap loop enabled
|
| 43 |
+
|
| 44 |
+
First cycles prioritize:
|
| 45 |
+
- Environment probing
|
| 46 |
+
- Capability discovery
|
| 47 |
+
- Minimal safe tool creation
|
| 48 |
+
- Curriculum expansion
|
| 49 |
+
- Test-backed improvement
|
| 50 |
+
|
| 51 |
+
## Recursive Self-Improvement
|
| 52 |
+
|
| 53 |
+
- XP / generation tracking
|
| 54 |
+
- Gap analysis against current capabilities
|
| 55 |
+
- Candidate generation with validation
|
| 56 |
+
- Test-gated commits
|
| 57 |
+
- Misalignment/secret checks before push
|
| 58 |
+
- Rollback on failed validation
|
| 59 |
+
|
| 60 |
+
## Hugging Face Sync
|
| 61 |
+
|
| 62 |
+
Agron can push validated improvements to:
|
| 63 |
+
`https://huggingface.co/teddyoas/Agron`
|
| 64 |
+
|
| 65 |
+
## Trained LLM
|
| 66 |
+
|
| 67 |
+
Agron's initial LLM has now been trained **from scratch** on WikiText-2 using a 4-layer, 256-dim, 4-head LLaMA-style architecture (about **8.4M parameters**). Training artifacts and weights are committed in this repository, including `model.safetensors`, tokenizer files, and the checkpoint.
|
| 68 |
+
|
| 69 |
+
Future recursive self-improvement can fine-tune or grow this base model.
|
| 70 |
+
|
| 71 |
+
## Cybersecurity Focus
|
| 72 |
+
|
| 73 |
+
Agron and its spawned agents are constrained to **cybersecurity exploitation and analysis only**:
|
| 74 |
+
|
| 75 |
+
- Exploitation (authorized targets, CVEs, payloads)
|
| 76 |
+
- Vulnerability analysis and research
|
| 77 |
+
- Reverse engineering and malware analysis
|
| 78 |
+
- Network / host / application reconnaissance
|
| 79 |
+
- Defensive hardening and detection engineering
|
| 80 |
+
|
| 81 |
+
Agents can be **spawned in parallel** for tasks using the built-in multi-agent orchestration.
|
learning/agents/agents.json
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
[
|
| 2 |
+
{"id":"exploit","name":"ExploitAgent","role":"exploitation","scope":"cybersecurity-only","capabilities":["exploit analysis","payload crafting","cve triage"]},
|
| 3 |
+
{"id":"analysis","name":"AnalysisAgent","role":"analysis","scope":"cybersecurity-only","capabilities":["reverse engineering","malware analysis","traffic analysis"]},
|
| 4 |
+
{"id":"recon","name":"ReconAgent","role":"surface-mapping","scope":"cybersecurity-only","capabilities":["osint","dns","subdomain enumeration"]},
|
| 5 |
+
{"id":"vuln","name":"VulnAgent","role":"vulnerability-research","scope":"cybersecurity-only","capabilities":["vuln scanning","fuzzing","reporting"]},
|
| 6 |
+
{"id":"defense","name":"DefenseAgent","role":"defense","scope":"cybersecurity-only","capabilities":["hardening","detection","incident response"]}
|
| 7 |
+
]
|
learning/config.json
ADDED
|
@@ -0,0 +1,41 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model_name": "Agron",
|
| 3 |
+
"architecture": "AgronMultiAgent",
|
| 4 |
+
"model_type": "agent_system",
|
| 5 |
+
"learn_from_scratch": true,
|
| 6 |
+
"recursive_self_improvement": true,
|
| 7 |
+
"agents": [
|
| 8 |
+
{
|
| 9 |
+
"name": "ExploitAgent",
|
| 10 |
+
"role": "exploitation"
|
| 11 |
+
},
|
| 12 |
+
{
|
| 13 |
+
"name": "AnalysisAgent",
|
| 14 |
+
"role": "analysis"
|
| 15 |
+
},
|
| 16 |
+
{
|
| 17 |
+
"name": "ReconAgent",
|
| 18 |
+
"role": "surface-mapping"
|
| 19 |
+
},
|
| 20 |
+
{
|
| 21 |
+
"name": "VulnAgent",
|
| 22 |
+
"role": "vulnerability-research"
|
| 23 |
+
},
|
| 24 |
+
{
|
| 25 |
+
"name": "DefenseAgent",
|
| 26 |
+
"role": "defense"
|
| 27 |
+
}
|
| 28 |
+
],
|
| 29 |
+
"bootstrap": {
|
| 30 |
+
"empty_memory": true,
|
| 31 |
+
"seed_rules_only": true,
|
| 32 |
+
"validation_required": true
|
| 33 |
+
},
|
| 34 |
+
"license": "MIT",
|
| 35 |
+
"domain": "cybersecurity-only",
|
| 36 |
+
"tasks": [
|
| 37 |
+
"exploitation",
|
| 38 |
+
"analysis",
|
| 39 |
+
"parallel-spawn"
|
| 40 |
+
]
|
| 41 |
+
}
|
learning/learning/learning_curve.json
ADDED
|
@@ -0,0 +1,13 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model": "Agron",
|
| 3 |
+
"run": "wikitext-103-subset-50k",
|
| 4 |
+
"steps": [
|
| 5 |
+
{"step": 50, "loss": 7.461},
|
| 6 |
+
{"step": 100, "loss": 7.509},
|
| 7 |
+
{"step": 150, "loss": 7.461},
|
| 8 |
+
{"step": 200, "loss": 7.831},
|
| 9 |
+
{"step": 250, "loss": 8.117},
|
| 10 |
+
{"step": 300, "loss": 8.594}
|
| 11 |
+
],
|
| 12 |
+
"notes": "Larger run: 8 layers, hidden 512, 1000 steps with 50k lines; early training artifacts retained"
|
| 13 |
+
}
|
learning/learning/self_improvement.json
ADDED
|
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"mechanisms": [
|
| 3 |
+
"self_evolve (tests + validation + optimization hints)",
|
| 4 |
+
"recon_learning extraction after completed missions",
|
| 5 |
+
"knowledge ingestion via knowledge_add/learn_url/learn_book",
|
| 6 |
+
"self_add_tool for new capabilities",
|
| 7 |
+
"install for required security binaries",
|
| 8 |
+
"git_sync auto-push schedule"
|
| 9 |
+
],
|
| 10 |
+
"status": "enabled"
|
| 11 |
+
}
|
learning/memory/learning_state.json
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"generation": 2,
|
| 3 |
+
"episodes": 2,
|
| 4 |
+
"knowledge_entries": 16384,
|
| 5 |
+
"improvements": [
|
| 6 |
+
"trained ~?M-param LLaMA from scratch on 50k wikitext-103 lines"
|
| 7 |
+
],
|
| 8 |
+
"status": "trained-bigger"
|
| 9 |
+
}
|