Instructions to use AofaYu71/LatentSkill with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use AofaYu71/LatentSkill with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("AofaYu71/LatentSkill", dtype="auto", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Add LatentSkill model card
Browse files
README.md
ADDED
|
@@ -0,0 +1,80 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
base_model:
|
| 4 |
+
- Qwen/Qwen3-8B
|
| 5 |
+
library_name: transformers
|
| 6 |
+
datasets:
|
| 7 |
+
- AofaYu71/LatentSkill
|
| 8 |
+
language:
|
| 9 |
+
- en
|
| 10 |
+
tags:
|
| 11 |
+
- agents
|
| 12 |
+
- large-language-models
|
| 13 |
+
- qwen3
|
| 14 |
+
- lora
|
| 15 |
+
- hypernetwork
|
| 16 |
+
- skill-learning
|
| 17 |
+
---
|
| 18 |
+
|
| 19 |
+
# LatentSkill Checkpoints
|
| 20 |
+
|
| 21 |
+
This model repository contains the released checkpoints for **LatentSkill: From In-Context Textual Skills to In-Weight Latent Skills for LLM Agents**.
|
| 22 |
+
|
| 23 |
+
Code: https://github.com/yuaofan0-oss/LatentSkill
|
| 24 |
+
Paper: https://arxiv.org/abs/2606.06087
|
| 25 |
+
Dataset repository: https://huggingface.co/datasets/AofaYu71/LatentSkill
|
| 26 |
+
|
| 27 |
+
## Contents
|
| 28 |
+
|
| 29 |
+
```text
|
| 30 |
+
checkpoints/
|
| 31 |
+
latentskill_pretrain_qwen3_8b/
|
| 32 |
+
pretrain.tar.gz
|
| 33 |
+
latentskill_sft_qwen3_8b/
|
| 34 |
+
train.tar.gz
|
| 35 |
+
```
|
| 36 |
+
|
| 37 |
+
The checkpoint archives are expected to be extracted under the code repository root:
|
| 38 |
+
|
| 39 |
+
```text
|
| 40 |
+
checkpoints/latentskill_pretrain_qwen3_8b/pretrain/
|
| 41 |
+
checkpoints/latentskill_sft_qwen3_8b/train/
|
| 42 |
+
```
|
| 43 |
+
|
| 44 |
+
## Download
|
| 45 |
+
|
| 46 |
+
From the root of the code repository:
|
| 47 |
+
|
| 48 |
+
```bash
|
| 49 |
+
hf download AofaYu71/LatentSkill \
|
| 50 |
+
--repo-type model \
|
| 51 |
+
--local-dir . \
|
| 52 |
+
--include "checkpoints/latentskill_pretrain_qwen3_8b/pretrain.tar.gz" \
|
| 53 |
+
"checkpoints/latentskill_sft_qwen3_8b/train.tar.gz"
|
| 54 |
+
|
| 55 |
+
tar -xzf checkpoints/latentskill_pretrain_qwen3_8b/pretrain.tar.gz \
|
| 56 |
+
-C checkpoints/latentskill_pretrain_qwen3_8b/
|
| 57 |
+
|
| 58 |
+
tar -xzf checkpoints/latentskill_sft_qwen3_8b/train.tar.gz \
|
| 59 |
+
-C checkpoints/latentskill_sft_qwen3_8b/
|
| 60 |
+
```
|
| 61 |
+
|
| 62 |
+
## Intended Use
|
| 63 |
+
|
| 64 |
+
These checkpoints are intended for reproducing the LatentSkill training and evaluation pipeline described in the paper. They are used with the LatentSkill codebase and the Qwen3-8B backbone.
|
| 65 |
+
|
| 66 |
+
The checkpoints are not standalone conversational models. Please load them through the project code and follow the paths documented in the GitHub README.
|
| 67 |
+
|
| 68 |
+
## Citation
|
| 69 |
+
|
| 70 |
+
```bibtex
|
| 71 |
+
@article{yu2026latentskillincontexttextualskills,
|
| 72 |
+
title={LatentSkill: From In-Context Textual Skills to In-Weight Latent Skills for LLM Agents},
|
| 73 |
+
author={Aofan Yu and Chenyu Zhou and Tianyi Xu and Zihan Guo and Rong Shan and Zhihui Fu and Jun Wang and Weiwen Liu and Yong Yu and Weinan Zhang and Jianghao Lin},
|
| 74 |
+
year={2026},
|
| 75 |
+
eprint={2606.06087},
|
| 76 |
+
archivePrefix={arXiv},
|
| 77 |
+
primaryClass={cs.CL},
|
| 78 |
+
url={https://arxiv.org/abs/2606.06087},
|
| 79 |
+
}
|
| 80 |
+
```
|