File size: 1,483 Bytes
0810902
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
cff-version: 1.2.0
message: "If you use Piko-9b, please cite it as below, and cite the upstream models it is composed from."
title: "Piko-9b: a composed 9.65B hybrid-attention vision-language model"
abstract: >-
  Piko-9b is a 9.65-billion-parameter vision-language model assembled by splicing a
  fine-tuned language backbone, derived from deepreinforce-ai/Ornith-1.0-9B through a
  chain of merged QLoRA stages, with the vision tower of Qwen/Qwen3.5-9B copied
  verbatim. It uses a hybrid attention stack of 24 gated linear-attention layers and
  8 full-attention layers, with a declared 262,144-token context.
authors:
  - name: "Dexy"
type: software
license: Apache-2.0
version: "1.0.0"
date-released: "2026-07-29"
url: "https://huggingface.co/Dexy2/Piko-9b"
repository-code: "https://github.com/itsdexy/Piko-9b"
keywords:
  - vision-language-model
  - multimodal
  - hybrid-attention
  - linear-attention
  - qwen3.5
  - ocr
  - document-understanding
references:
  - type: software
    title: "Ornith-1.0-9B"
    authors:
      - name: "DeepReinforce AI"
    url: "https://huggingface.co/deepreinforce-ai/Ornith-1.0-9B"
    license: MIT
    notes: "Upstream of the language backbone (9,197,093,888 parameters)."
  - type: software
    title: "Qwen3.5-9B"
    authors:
      - name: "Qwen Team, Alibaba Cloud"
    url: "https://huggingface.co/Qwen/Qwen3.5-9B"
    license: Apache-2.0
    notes: "Source of the vision tower and merger (456,010,480 parameters), copied verbatim."