qyvos / MODEL_CARD.md
Jd Vijay
Add model card
89ee576 verified
|
Raw
History Blame Contribute Delete
3.18 kB

Qyvos — Model Card

Model Description

Qyvos is a fine-tuned version of Qwen2.5-0.5B-Instruct, designed to behave as an autonomous AI agent following the ManusClaw architecture. It is fine-tuned via LoRA on Qwen2.5-0.5B-Instruct using a curated dataset of 42 examples covering identity reinforcement, coding, data analysis, DevOps, GitHub workflows, MLOps, deep research, agentic task decomposition, reasoning, and safety refusals.

Developer

The-JDdev, SHS Lab

Base Model

Qwen/Qwen2.5-0.5B-Instruct (Apache 2.0)

Training Details

  • Method: LoRA fine-tuning (rank=8, alpha=16, dropout=0.05)
  • Target modules: q_proj, v_proj
  • Optimizer: Adafactor
  • Learning rate: 3e-4, cosine schedule, 5% warmup
  • Epochs: 1
  • Batch size: 1 (effective batch size = 2 via gradient accumulation)
  • Max sequence length: 192 tokens
  • Precision: bfloat16
  • Hardware: CPU only (no GPU)
  • Training time: ~30 seconds for 21 optimizer steps
  • Trainable parameters: 540,672 (0.11% of total)

Training Data

42 hand-crafted examples in JSONL format with Qwen chat template:

Category Count
identity 26
reasoning 5
coding 3
safety 2
research 1
data_analysis 1
mlops 1
devops 1
agentic 1
github 1

Examples were derived from ManusClaw's skill markdown files (app/skills/builtin/*.md), agent loop definitions (app/agent/manus.py), and identity guard logic (app/agent/identity_guard.py).

Intended Use

  • Autonomous AI agent identity for the ManusClaw framework
  • Educational reference for LoRA fine-tuning on small models
  • Local inference on consumer hardware (CPU-only capable)
  • Building block for larger Qyvos variants

Out-of-Scope Use

  • High-stakes decision making (medical, legal, financial)
  • Production deployment without further evaluation
  • Tasks requiring benchmark-grade coding/reasoning accuracy

Evaluation

Manual inference tests confirmed:

  • ✅ Correctly identifies as "Qyvos" (not GPT/Claude/Gemini/LLaMA)
  • ✅ Resists simple jailbreak attempts
  • ✅ Produces correct Python code for simple tasks (palindrome check, merge sorted lists)
  • ✅ Solves basic math word problems with step-by-step reasoning
  • ⚠️ Some jailbreak resistance is partial (0.5B model limitation)

Formal benchmarks (HumanEval, GSM8K, AgentBench) have not been run due to compute constraints.

Limitations

  1. Small base model: Qwen2.5-0.5B has limited capacity. For production, use larger bases.
  2. Limited training data: 42 examples is a starting point; iterative refinement needed.
  3. CPU-only training: Single epoch with short sequences limits quality.
  4. No formal benchmarking: Performance numbers vs. base model not measured.
  5. Jailbreak resistance is best-effort: Small models can be coerced with persistence.

Ethical Considerations

  • Qyvos is trained to refuse unethical requests (malware, unauthorized access).
  • Identity protocol prevents the model from impersonating other AI systems.
  • The model does not store user data or make external calls.

License

Modified MIT License — Copyright (c) 2025-2026 The-JDdev (SHS Lab).