Improve model card: Add `library_name`, `pipeline_tag`, paper, and GitHub links

README.md

@@ -1,14 +1,21 @@
 ---
-license: mit
 datasets:
 - teknium/OpenHermes-2.5
 - HuggingFaceTB/smollm-corpus
 - mlfoundations/dclm-baseline-1.0
+license: mit
+pipeline_tag: text-generation
+library_name: transformers
 ---
+
 # Model Card for LRC-4B-Base
 
+This repository hosts the **LRC-4B-Base** model, introduced in the paper [A Token is Worth over 1,000 Tokens: Efficient Knowledge Distillation through Low-Rank Clone](https://huggingface.co/papers/2505.12781).
+
 LRC-4B-Base is a Small Language Model (SLM) with approximately 4 billion parameters. It is the base pre-trained version, developed using the **Low-Rank Clone (LRC)** method, before any Supervised Fine-Tuning (SFT). The LRC method is an efficient knowledge distillation technique designed to construct SLMs that aspire to behavioral equivalence with larger, more powerful teacher models. This model was distilled from **Qwen2.5-7B-Instruct**.
 
+The official codebase is available at: [https://github.com/CURRENTF/LowRankClone](https://github.com/CURRENTF/LowRankClone)
+
 The LRC approach trains a set of low-rank projection matrices that enable soft pruning by compressing teacher weights and an "activation clone" mechanism that aligns student activations (including FFN signals) with those of the teacher. LRC-4B-Base was trained on **18 billion tokens**, demonstrating significant training efficiency compared to models trained on trillions of tokens.
 
 ## Uses