File size: 1,111 Bytes
5d61448 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 | """
TD Fuse — Transport and Merge pipeline for Time Dilation project.
Merges 5 different-architecture 7B models into Qwen3-8B using
optimal transport (Transport and Merge, arxiv 2602.05495).
Architecture:
td_fuse/
├── __init__.py ← This file
├── config.py ← Model configs, merge order, hyperparameters
├── canary.py ← Canary injection + testing ("brain surgery")
├── transport.py ← Wrapper around official T&M code
├── techniques.py ← Advanced techniques (Theseus, ARM, OTMF, RAM, Mergeability)
├── merge.py ← Sequential merge orchestrator
├── validate.py ← Post-merge validation (canary, perplexity, benchmarks)
├── heal.py ← QLoRA healing fine-tune via Unsloth
└── run.py ← Main entry point
Usage:
python -m td_fuse.run --config default --stage all
python -m td_fuse.run --config default --stage demo # Dad demo (DeepSeek only)
"""
__version__ = "0.1.0"
__author__ = "Milan (TD Project)"
|