abcsk123
/

PyraCode-1.5B

Text Generation

Model card Files Files and versions

abcsk123 commited on 8 days ago

Commit

7955339

·

verified ·

1 Parent(s): 4c6edb8

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -25,8 +25,8 @@ tags:
 This is a custom-architected model based on `Qwen2.5-Coder-1.5B`. We introduced a novel **Asymmetric Hybrid Architecture (GQA + MLA)** with **Cross-Layer Shared Latent Gates** and **Attention Sinks**, enabling efficient feature communication and reduced KV-Cache memory footprint.
 ## 🏗️ Architecture Innovations
-![Uploading qwen2_hybrid_arch.png…]()
 Unlike standard Qwen2 models, this `Hybrid-v9` backbone features:
 1. **Asymmetric Layers:**

 This is a custom-architected model based on `Qwen2.5-Coder-1.5B`. We introduced a novel **Asymmetric Hybrid Architecture (GQA + MLA)** with **Cross-Layer Shared Latent Gates** and **Attention Sinks**, enabling efficient feature communication and reduced KV-Cache memory footprint.
 ## 🏗️ Architecture Innovations
+![qwen2_hybrid_arch](https://cdn-uploads.huggingface.co/production/uploads/67cd51087c6e6ea1cc18d236/2pYTkGmwcgRMxQr8qBVB3.png)
 Unlike standard Qwen2 models, this `Hybrid-v9` backbone features:
 1. **Asymmetric Layers:**