Add model card and config files for FableForge

README.md

@@ -0,0 +1,117 @@
+---
+language:
+- en
+license: mit
+library_name: transformers
+pipeline_tag: text-generation
+tags:
+- fableforge
+- agent
+- code-generation
+- tool-use
+- reasoning
+- base
+base_model: meta-llama/Llama-2-7b-chat-hf
+---
+
+# FableForge
+
+The base unified agent model - a 7B parameter model fine-tuned for agent tasks including planning, tool use, code generation, and self-correction. The foundation model for the FableForge ecosystem.
+
+## Quick Start
+
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+model_name = "fableforge-ai/FableForge"
+tokenizer = AutoTokenizer.from_pretrained(model_name)
+model = AutoModelForCausalLM.from_pretrained(model_name, device_map="auto")
+
+prompt = """You are an AI agent. Complete the following task:
+
+Task: Write a Python function to calculate the Fibonacci sequence.
+
+Reasoning:"""
+
+inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
+outputs = model.generate(**inputs, max_new_tokens=512, temperature=0.6, top_p=0.9)
+print(tokenizer.decode(outputs[0], skip_special_tokens=True))
+```
+
+## Use Cases
+
+- General-purpose agent tasks
+- Planning and decomposition
+- Code generation with self-verification
+- Integration with FableForge runtime and tools
+
+### Integration with FableForge Ecosystem
+
+```python
+from fableforge_agent_runtime import AgentRuntime
+from fableforge_agent_skills import SkillLibrary
+
+runtime = AgentRuntime(
+    model="fableforge-ai/FableForge",
+    skills=SkillLibrary.all(),
+    verification=True
+)
+
+result = runtime.run("Deploy a web server on AWS")
+print(result.output)
+print(result.verification_score)
+```
+
+## Ecosystem Integration
+
+Part of the **FableForge Agent Ecosystem** - 21 open-source projects for building, testing, and deploying AI agents.
+
+| Package | Install | Purpose |
+|---------|---------|---------|
+| `fableforge` | `pip install fableforge` | Unified CLI |
+| `fableforge-anvil-agent` | `pip install fableforge-anvil-agent` | Self-verified coding agent |
+| `fableforge-agent-swarm` | `pip install fableforge-agent-swarm` | Multi-agent orchestration |
+| `fableforge-agent-runtime` | `pip install fableforge-agent-runtime` | Production agent runtime |
+| `fableforge-agent-skills` | `pip install fableforge-agent-skills` | Skill library |
+| `verifyloop` | `pip install verifyloop` | Verification loops |
+| `reason-critic` | `pip install reason-critic` | Reasoning assessment |
+
+## Model Details
+
+| Attribute | Value |
+|-----------|-------|
+| Architecture | LlamaForCausalLM |
+| Parameters | 7B |
+| Hidden Size | 4096 |
+| Layers | 32 |
+| Attention Heads | 32 |
+| KV Heads | 32 |
+| Max Context | 4096 |
+| Training Data | Fable5 agent traces + curated reasoning datasets |
+| License | MIT |
+
+## Limitations
+
+- May generate incorrect code -- always use with verifyloop for critical tasks
+- Trained primarily on English data; multilingual performance is limited
+- Can hallucinate API signatures or tool parameters
+- Not suitable for medical, legal, or financial advice without human review
+
+## Citation
+
+```bibtex
+@misc{fableforge2024,
+  title={FableForge: Agent Orchestration via Fine-Tuned Language Models},
+  author={FableForge Team},
+  year={2024},
+  url={https://huggingface.co/fableforge-ai/FableForge}
+}
+```
+
+## License
+
+MIT License - see [LICENSE](LICENSE) for details.
+
+---
+
+Built with hammer by the [FableForge](https://github.com/KingLabsA) team. Part of the [FableForge ecosystem](https://kinglabsa.github.io/fableforge/).

config.json

@@ -0,0 +1,21 @@
+{
+  "architectures": [
+    "LlamaForCausalLM"
+  ],
+  "model_type": "llama",
+  "hidden_size": 4096,
+  "intermediate_size": 11008,
+  "num_hidden_layers": 32,
+  "num_attention_heads": 32,
+  "num_key_value_heads": 32,
+  "vocab_size": 32000,
+  "max_position_embeddings": 4096,
+  "rms_norm_eps": 1e-05,
+  "rope_theta": 10000.0,
+  "tie_word_embeddings": false,
+  "torch_dtype": "float16",
+  "use_cache": true,
+  "bos_token_id": 1,
+  "eos_token_id": 2,
+  "pad_token_id": 0
+}

generation_config.json

@@ -0,0 +1,10 @@
+{
+  "bos_token_id": 1,
+  "eos_token_id": 2,
+  "do_sample": true,
+  "temperature": 0.6,
+  "top_p": 0.9,
+  "top_k": 50,
+  "repetition_penalty": 1.1,
+  "max_new_tokens": 2048
+}

special_tokens_map.json

@@ -0,0 +1,9 @@
+{
+  "bos_token": "<s>",
+  "eos_token": "</s>",
+  "unk_token": "<unk>",
+  "pad_token": "<pad>",
+  "sep_token": "</s>",
+  "cls_token": "<s>",
+  "mask_token": "<mask>"
+}

tokenizer.json

@@ -0,0 +1,65 @@
+{
+  "version": "1.0.0",
+  "truncation": null,
+  "padding": null,
+  "added_tokens": [
+    {
+      "id": 0,
+      "content": "<unk>",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 1,
+      "content": "<s>",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 2,
+      "content": "</s>",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    }
+  ],
+  "normalizer": null,
+  "pre_tokenizer": {
+    "type": "ByteLevel",
+    "add_prefix_space": false,
+    "trim_offsets": true,
+    "use_regex": true
+  },
+  "post_processor": {
+    "type": "ByteLevel",
+    "add_prefix_space": true,
+    "trim_offsets": false,
+    "use_regex": true
+  },
+  "decoder": {
+    "type": "ByteLevel"
+  },
+  "model": {
+    "type": "BPE",
+    "dropout": null,
+    "unk_token": "<unk>",
+    "continuing_subword_prefix": null,
+    "end_of_word_suffix": null,
+    "fuse_unk": false,
+    "byte_fallback": false,
+    "vocab": {
+      "<unk>": 0,
+      "<s>": 1,
+      "</s>": 2
+    },
+    "merges": []
+  }
+}

tokenizer_config.json

@@ -0,0 +1,37 @@
+{
+  "add_bos_token": true,
+  "add_eos_token": false,
+  "add_prefix_space": false,
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "model_type": "llama",
+  "model_max_length": 4096,
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "clean_up_tokenization_spaces": false
+}