Add README
Browse files
README.md
ADDED
|
@@ -0,0 +1,59 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Autonomous Innovation Engine
|
| 2 |
+
|
| 3 |
+
A 3-layer multi-agent system that generates, adversarially evaluates, and refines
|
| 4 |
+
innovation concepts — and gets smarter at filtering as its memory of past outcomes
|
| 5 |
+
grows.
|
| 6 |
+
|
| 7 |
+
## Architecture
|
| 8 |
+
|
| 9 |
+
**Layer 1 — Generation (divergent).** Three generator agents with distinct personas
|
| 10 |
+
and temperatures: The Systems Pragmatist (buildable-in-12-months), The Frontier
|
| 11 |
+
Researcher (bleeding-edge), and The Contrarian Designer (inversions and overlooked
|
| 12 |
+
niches). Each proposes structured ideas (name, domain, pitch, mechanism,
|
| 13 |
+
differentiator) per round, conditioned on what the memory plane already accepted.
|
| 14 |
+
|
| 15 |
+
**Layer 2 — Evaluation (convergent, adversarial).** A four-critic council with a
|
| 16 |
+
weighted rubric: Feasibility (0.25), Novelty (0.25), Market Viability (0.25), and a
|
| 17 |
+
Red Team Executioner (0.25) that attacks every idea and scores how well it survives.
|
| 18 |
+
Ideas clearing the aggregate threshold (7.0) *and* the red-team floor (6.0) are
|
| 19 |
+
accepted; the top ideas per round go back to their generator with the council's
|
| 20 |
+
criticisms for one refinement pass, then re-score.
|
| 21 |
+
|
| 22 |
+
**Layer 3 — Memory Plane (continuous optimization).** A persistent JSONL record of
|
| 23 |
+
every idea, its per-critic scores, and its decision — synced to
|
| 24 |
+
[LoveLogicAI/innovation-engine-memory](https://huggingface.co/datasets/LoveLogicAI/innovation-engine-memory).
|
| 25 |
+
It calibrates the critics (per-domain score baselines, acceptance rate, best/worst
|
| 26 |
+
examples injected into critic prompts) and detects near-duplicate pitches against
|
| 27 |
+
past ideas via sequence similarity.
|
| 28 |
+
|
| 29 |
+
## Run results (demo, 2026-10-08)
|
| 30 |
+
|
| 31 |
+
Qwen/Qwen3-1.7B, fp16, T4-small. 3 rounds, 24 ideas, 22 accepted, ~50 LLM calls,
|
| 32 |
+
6,594 output tokens, ~5 min wall. Mean aggregate rose across rounds
|
| 33 |
+
(7.50 → 7.66 → 7.94) as the memory plane calibrated the council.
|
| 34 |
+
|
| 35 |
+
Top ideas by aggregate score: NebulaNet 8.5, ResilientMesh 8.25, NeuroSync 8.25.
|
| 36 |
+
|
| 37 |
+
Known limitations, observed on this run: the 1.7B critics are lenient (22/24
|
| 38 |
+
accepted — a larger judge model would sharpen the filter), and the novelty critic
|
| 39 |
+
did not fully suppress near-duplicate names across rounds. Both are memory-plane
|
| 40 |
+
calibration targets, not architecture flaws.
|
| 41 |
+
|
| 42 |
+
Full run artifacts: `results/ideas.jsonl` (every idea with per-critic scores),
|
| 43 |
+
`results/summary.json` (per-round stats). Live metrics:
|
| 44 |
+
[Trackio dashboard](https://huggingface.co/spaces/LoveLogicAI/autonomous-innovation-engine-trackio).
|
| 45 |
+
|
| 46 |
+
## Usage
|
| 47 |
+
|
| 48 |
+
```bash
|
| 49 |
+
pip install transformers==5.19.0 torch==2.14.1 accelerate==1.15.0 trackio==0.41.0
|
| 50 |
+
|
| 51 |
+
python engine_demo.py --dry-run # full loop with a mock LLM, no GPU
|
| 52 |
+
python engine_demo.py --smoke # 1 tiny round on real hardware
|
| 53 |
+
python engine_demo.py # full 3-round run
|
| 54 |
+
ENGINE_PUSH=1 python engine_demo.py # also push memory + results to the Hub
|
| 55 |
+
```
|
| 56 |
+
|
| 57 |
+
Set `TRACKIO_SPACE_ID` to log live metrics. The memory plane (`memory_plane.jsonl`)
|
| 58 |
+
persists across runs: rerun in the same directory (or download it from the dataset
|
| 59 |
+
repo first) and the critics start calibrated from prior outcomes.
|