teddyoas commited on
Commit
0ee025d
·
verified ·
1 Parent(s): 513d800

Upload folder using huggingface_hub

Browse files
learning/README.md ADDED
@@ -0,0 +1,81 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: mit
5
+ tags:
6
+ - agent
7
+ - multi-agent
8
+ - autonomous
9
+ - self-improving
10
+ - recursive
11
+ - learn-from-scratch
12
+ - huggingface
13
+ pipeline_tag: text-generation
14
+ ---
15
+
16
+ # Agron — Self-Improving Multi-Agent AI
17
+
18
+ **Agron** is an autonomous, self-improving AI agent system that **learns from scratch**.
19
+ It starts with empty memory and bootstrap rules, then recursively improves through:
20
+
21
+ 1. Observation of task outcomes
22
+ 2. Memory consolidation and knowledge graph growth
23
+ 3. Tool/strategy evolution and validation
24
+ 4. Safe self-modification with tests
25
+ 5. Optional synchronization to Hugging Face
26
+
27
+ ## Agent Team
28
+
29
+ | Agent | Role | Specialty |
30
+ |---|---|---|
31
+ | Coordinator | Orchestrator | Decomposes work, delegates, synthesizes |
32
+ | Learner | Knowledge | Ingests, distills, updates memory from scratch |
33
+ | Builder | Improvement | Generates new tools/strategies recursively |
34
+ | Guardian | Safety | Validates changes, prevents regressions |
35
+
36
+ ## Learn From Scratch
37
+
38
+ Agron begins with:
39
+ - Empty episodic memory
40
+ - No imported knowledge
41
+ - Seed evaluation rules only
42
+ - Bootstrap loop enabled
43
+
44
+ First cycles prioritize:
45
+ - Environment probing
46
+ - Capability discovery
47
+ - Minimal safe tool creation
48
+ - Curriculum expansion
49
+ - Test-backed improvement
50
+
51
+ ## Recursive Self-Improvement
52
+
53
+ - XP / generation tracking
54
+ - Gap analysis against current capabilities
55
+ - Candidate generation with validation
56
+ - Test-gated commits
57
+ - Misalignment/secret checks before push
58
+ - Rollback on failed validation
59
+
60
+ ## Hugging Face Sync
61
+
62
+ Agron can push validated improvements to:
63
+ `https://huggingface.co/teddyoas/Agron`
64
+
65
+ ## Trained LLM
66
+
67
+ Agron's initial LLM has now been trained **from scratch** on WikiText-2 using a 4-layer, 256-dim, 4-head LLaMA-style architecture (about **8.4M parameters**). Training artifacts and weights are committed in this repository, including `model.safetensors`, tokenizer files, and the checkpoint.
68
+
69
+ Future recursive self-improvement can fine-tune or grow this base model.
70
+
71
+ ## Cybersecurity Focus
72
+
73
+ Agron and its spawned agents are constrained to **cybersecurity exploitation and analysis only**:
74
+
75
+ - Exploitation (authorized targets, CVEs, payloads)
76
+ - Vulnerability analysis and research
77
+ - Reverse engineering and malware analysis
78
+ - Network / host / application reconnaissance
79
+ - Defensive hardening and detection engineering
80
+
81
+ Agents can be **spawned in parallel** for tasks using the built-in multi-agent orchestration.
learning/agents/agents.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ [
2
+ {"id":"exploit","name":"ExploitAgent","role":"exploitation","scope":"cybersecurity-only","capabilities":["exploit analysis","payload crafting","cve triage"]},
3
+ {"id":"analysis","name":"AnalysisAgent","role":"analysis","scope":"cybersecurity-only","capabilities":["reverse engineering","malware analysis","traffic analysis"]},
4
+ {"id":"recon","name":"ReconAgent","role":"surface-mapping","scope":"cybersecurity-only","capabilities":["osint","dns","subdomain enumeration"]},
5
+ {"id":"vuln","name":"VulnAgent","role":"vulnerability-research","scope":"cybersecurity-only","capabilities":["vuln scanning","fuzzing","reporting"]},
6
+ {"id":"defense","name":"DefenseAgent","role":"defense","scope":"cybersecurity-only","capabilities":["hardening","detection","incident response"]}
7
+ ]
learning/config.json ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model_name": "Agron",
3
+ "architecture": "AgronMultiAgent",
4
+ "model_type": "agent_system",
5
+ "learn_from_scratch": true,
6
+ "recursive_self_improvement": true,
7
+ "agents": [
8
+ {
9
+ "name": "ExploitAgent",
10
+ "role": "exploitation"
11
+ },
12
+ {
13
+ "name": "AnalysisAgent",
14
+ "role": "analysis"
15
+ },
16
+ {
17
+ "name": "ReconAgent",
18
+ "role": "surface-mapping"
19
+ },
20
+ {
21
+ "name": "VulnAgent",
22
+ "role": "vulnerability-research"
23
+ },
24
+ {
25
+ "name": "DefenseAgent",
26
+ "role": "defense"
27
+ }
28
+ ],
29
+ "bootstrap": {
30
+ "empty_memory": true,
31
+ "seed_rules_only": true,
32
+ "validation_required": true
33
+ },
34
+ "license": "MIT",
35
+ "domain": "cybersecurity-only",
36
+ "tasks": [
37
+ "exploitation",
38
+ "analysis",
39
+ "parallel-spawn"
40
+ ]
41
+ }
learning/learning/learning_curve.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "Agron",
3
+ "run": "wikitext-103-subset-50k",
4
+ "steps": [
5
+ {"step": 50, "loss": 7.461},
6
+ {"step": 100, "loss": 7.509},
7
+ {"step": 150, "loss": 7.461},
8
+ {"step": 200, "loss": 7.831},
9
+ {"step": 250, "loss": 8.117},
10
+ {"step": 300, "loss": 8.594}
11
+ ],
12
+ "notes": "Larger run: 8 layers, hidden 512, 1000 steps with 50k lines; early training artifacts retained"
13
+ }
learning/learning/self_improvement.json ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "mechanisms": [
3
+ "self_evolve (tests + validation + optimization hints)",
4
+ "recon_learning extraction after completed missions",
5
+ "knowledge ingestion via knowledge_add/learn_url/learn_book",
6
+ "self_add_tool for new capabilities",
7
+ "install for required security binaries",
8
+ "git_sync auto-push schedule"
9
+ ],
10
+ "status": "enabled"
11
+ }
learning/memory/learning_state.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "generation": 2,
3
+ "episodes": 2,
4
+ "knowledge_entries": 16384,
5
+ "improvements": [
6
+ "trained ~?M-param LLaMA from scratch on 50k wikitext-103 lines"
7
+ ],
8
+ "status": "trained-bigger"
9
+ }