⚑ QJev-1.5B-LoRA: Lightweight PEFT Adapter (~20 MB)

Joint Attention Adapter + MLP Decision Head for Qwen/Qwen2.5-1.5B-Instruct

Hugging Face GitHub JevBench License


πŸ“¦ Part of the QJev Model Family:


πŸ’‘ Overview

QJev-1.5B-LoRA is the lightweight PEFT / LoRA adapter release for edge, mobile, and modular LLM deployments.

Instead of downloading the entire 3GB transformer weights, developers who already cache Qwen/Qwen2.5-1.5B-Instruct can download just 20 MB to equip their base model with high-speed System 1 decision-making capabilities.

  • Adapter Size: 17.5 MB (adapter_model.safetensors, targeting q_proj, k_proj, v_proj, o_proj, rank 16, alpha 32)
  • Decision Head Size: 3.18 MB (decision_head.safetensors, 1536 $\to$ 512 $\to$ 10)
  • JevBench Calibrated Score: 71.5% (Identical performance to full merged model)

πŸš€ Quickstart: Super Friendly 3-Line Decision

from qjev import QJev

# 1. Load the adapter in 1 line:
model = QJev.from_pretrained("devankit7873/QJev-1.5B-LoRA")

# 2. Decide in 31 ms!
result = model.decide(
    context="Production database primary replica CPU spiked to 100% and connection pool is exhausted.",
    choices=[
        "Trigger immediate automated failover to standby replica",
        "Restart the primary database daemon immediately",
        "Double connection pool limits without scaling compute",
        "Silence alerts and monitor for next 15 minutes"
    ]
)

print(f"πŸ‘‰ Recommended: {result['best_choice']} ({result['confidence']}%)")
for choice, prob in result['probabilities'].items():
    print(f"  [{prob:>5.2f}%]  {choice}")

πŸ“„ License

Released under the Apache 2.0 License. Base model governed by Alibaba Cloud Qwen License.

Downloads last month
38
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for devankit7873/QJev-1.5B-LoRA

Adapter
(1)
this model

Dataset used to train devankit7873/QJev-1.5B-LoRA