Instructions to use amaan784/agentic-world-behavioral with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use amaan784/agentic-world-behavioral with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-Instruct-v0.3") model = PeftModel.from_pretrained(base_model, "amaan784/agentic-world-behavioral") - Notebooks
- Google Colab
- Kaggle
Agentic World β Behavioral Digital Twin LoRA Adapters
Fine-tuned LoRA adapters for Mistral 7B Instruct v0.3, trained on real user behavior from PostHog session recordings. Each adapter represents a distinct behavioral demographic (e.g., Frustrated Clicker, Cautious Explorer, Engaged User, Speedster).
How it works
- Real user sessions recorded via PostHog (clicks, scrolls, inputs, navigation)
- Sessions parsed, described via Mistral, embedded, and clustered via K-Means
- Per-cluster training data generated as (page state β next action) pairs
- LoRA fine-tuned on A100 80GB with bf16, Flash Attention 2, packing
Training Details
- Base model: mistralai/Mistral-7B-Instruct-v0.3
- Method: LoRA (rank=32, alpha=64, all projection layers)
- Framework: HuggingFace TRL SFTTrainer + PEFT
- Hardware: NVIDIA A100 80GB on Brev
- Epochs: 5
- Tracked in: W&B Project
Clusters
Each cluster has its own LoRA adapter in PosthogAgent/data/models/cluster_N_lora/. The adapter at the root of this repo is cluster 0 (Speedster), the same files as PosthogAgent/data/models/cluster_0_lora/, so it loads without a subfolder.
| Cluster | Label | Description |
|---|---|---|
| 0 | Speedster | Fast, decisive navigation with minimal hesitation |
| 1 | Scanner | Quick browsing, skimming content |
| 2 | Erratic Clicker | Unpredictable click patterns |
| 3 | Cautious Explorer | Slow, careful reading and interaction |
| 4 | Frustrated Clicker | Repeated clicks, signs of confusion |
Usage
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-Instruct-v0.3")
model = PeftModel.from_pretrained(base, "amaan784/agentic-world-behavioral") # cluster 0, Speedster
# another cluster, e.g. 3 (Cautious Explorer):
# model = PeftModel.from_pretrained(base, "amaan784/agentic-world-behavioral",
# subfolder="PosthogAgent/data/models/cluster_3_lora")
tokenizer = AutoTokenizer.from_pretrained("mistralai/Mistral-7B-Instruct-v0.3")
Links
- GitHub: ShadowVerse (formerly PosthogAgent)
- W&B Training Runs
- Downloads last month
- 14
Inference Providers NEW
This model isn't deployed by any Inference Provider. π Ask for provider support
Model tree for amaan784/agentic-world-behavioral
Base model
mistralai/Mistral-7B-v0.3 Finetuned
mistralai/Mistral-7B-Instruct-v0.3