README.md

metadata

license: apache-2.0
tags:
  - game-ai
  - flow-matching
  - action-prediction
  - elden-ring
  - vla
base_model: Qwen/Qwen3.5-4B

Pi-Lumine 4B — Flow-Matching Action Decoder for Elden Ring

A Pi0.5-style flow-matching action decoder trained on top of a frozen Qwen3.5-4B VLM backbone.

Architecture

• Base VLM: Qwen/Qwen3.5-4B (frozen, not included — downloaded at runtime)
• Action Decoder: FiLM-conditioned transformer with cross-attention to VLM hidden states
  • 2 decoder layers, VLM dim 2560 → decoder dim 1024, 8 attention heads
  • Projection layers decouple decoder from VLM hidden size
  • Instruction-conditioned via AdaptiveRMSNorm (FiLM)
  • Sinusoidal time embedding for flow matching
  • ~64M trainable parameters
• Action Space: 6 steps x 20 dims (4 sticks + 16 buttons per step)
• Training: Flow matching with Euler ODE integration at inference

Files

• action_decoder.pt — Trained action decoder weights
• decoder_config.json — Architecture and tokenizer config
• tokenizer.json / tokenizer_config.json — Tokenizer with special tokens
• chat_template.jinja — Chat template
• processor_config.json — Processor config