Update README.md
Browse files
README.md
CHANGED
|
@@ -9,45 +9,24 @@ tags:
|
|
| 9 |
- analog-circuit-design
|
| 10 |
pipeline_tag: text-generation
|
| 11 |
model-index:
|
| 12 |
-
- name:
|
| 13 |
results: []
|
| 14 |
---
|
| 15 |
|
| 16 |
-
#
|
|
|
|
|
|
|
|
|
|
| 17 |
|
| 18 |
-
This model, `AnalogSeeker_2025_07_10_3`, is a fine-tuned version of `Qwen2.5-32B-Instruct`. It was presented in the paper [AnalogSeeker: An Open-source Foundation Language Model for Analog Circuit Design](https://huggingface.co/papers/2508.10409).
|
| 19 |
-
|
| 20 |
-
* **Project Page**: [https://huggingface.co/analogllm/analogseeker](https://huggingface.co/analogllm/analogseeker)
|
| 21 |
-
* **GitHub Repository**: [https://github.com/analogllm/AnalogSeeker](https://github.com/analogllm/AnalogSeeker)
|
| 22 |
|
| 23 |
## Model description
|
|
|
|
|
|
|
| 24 |
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
The model introduces a granular domain knowledge distillation method where raw, unlabeled domain corpus is decomposed into typical, granular learning nodes. A multi-agent framework is then utilized to distill implicit knowledge embedded in unstructured text into detailed question-answer data pairs, complete with detailed reasoning processes. This yields a fine-grained, learnable dataset used for fine-tuning. AnalogSeeker explores and shares novel training methods, establishing a fine-tuning-centric training paradigm and implementing a neighborhood self-constrained supervised fine-tuning algorithm to enhance training outcomes by constraining the perturbation magnitude between the model's output distributions.
|
| 28 |
-
|
| 29 |
-
## Intended uses & limitations
|
| 30 |
-
|
| 31 |
-
**Intended Uses:**
|
| 32 |
-
AnalogSeeker is intended for research use in the field of analog circuit design. It aims to:
|
| 33 |
-
* Integrate domain knowledge for analog circuits.
|
| 34 |
-
* Provide design assistance and answer domain-specific questions.
|
| 35 |
-
* Support tasks such as operational amplifier design.
|
| 36 |
-
* Serve as a foundation for further research and development in analog circuit LLMs.
|
| 37 |
-
|
| 38 |
-
**Limitations:**
|
| 39 |
While AnalogSeeker demonstrates strong performance on analog circuit knowledge evaluation benchmarks, it is specialized for this domain. Its applicability and performance in other, unrelated domains may be limited. Users should be aware that, like all language models, it may occasionally generate incorrect or nonsensical information, especially for highly novel or unrepresented concepts within its training data.
|
| 40 |
|
| 41 |
-
## Training and evaluation data
|
| 42 |
-
|
| 43 |
-
**Training Data:**
|
| 44 |
-
The model was trained on a meticulously collected corpus based on the domain knowledge framework of analog circuits. This corpus consists of high-quality, accessible textbooks across relevant subfields, systematically curated and cleaned. A granular domain knowledge distillation method was applied, where raw text was decomposed into learning nodes, and a multi-agent framework distilled implicit knowledge into question-answer data pairs with detailed reasoning for fine-tuning.
|
| 45 |
-
|
| 46 |
-
**Evaluation Data and Performance:**
|
| 47 |
-
AnalogSeeker was evaluated on AMSBench-TQA, the analog circuit knowledge evaluation benchmark. It achieved **85.04% accuracy**, marking a significant **15.67% point improvement** over the original Qwen2.5-32B-Instruct model and demonstrating competitive performance with mainstream commercial models.
|
| 48 |
-
|
| 49 |
## Sample Usage
|
| 50 |
-
|
| 51 |
You can use this model with the Hugging Face `transformers` library:
|
| 52 |
|
| 53 |
```python
|
|
@@ -156,17 +135,4 @@ The following hyperparameters were used during training:
|
|
| 156 |
- Pytorch 2.5.1+cu124
|
| 157 |
- Datasets 3.6.0
|
| 158 |
- Tokenizers 0.21.1
|
| 159 |
-
|
| 160 |
-
## Citation
|
| 161 |
-
|
| 162 |
-
If you find AnalogSeeker useful in your research, please consider citing the original paper:
|
| 163 |
-
|
| 164 |
-
```bibtex
|
| 165 |
-
@article{analogseeker2025,
|
| 166 |
-
title={AnalogSeeker: An Open-source Foundation Language Model for Analog Circuit Design},
|
| 167 |
-
author={AnalogSeeker Team}, # Author information not provided in the prompt's paper details, so a placeholder like 'AnalogSeeker Team' or 'Anonymous' is often used if no specific author list is given. In this case, 'AnalogSeeker Team' seems appropriate from the context.
|
| 168 |
-
journal={arXiv preprint arXiv:2508.10409},
|
| 169 |
-
year={2025}, # Year not directly stated, assuming from the paper ID 2508.10409 which implies 2025.
|
| 170 |
-
url={https://huggingface.co/papers/2508.10409},
|
| 171 |
-
}
|
| 172 |
```
|
|
|
|
| 9 |
- analog-circuit-design
|
| 10 |
pipeline_tag: text-generation
|
| 11 |
model-index:
|
| 12 |
+
- name: "to be named"
|
| 13 |
results: []
|
| 14 |
---
|
| 15 |
|
| 16 |
+
# A Fine-tuned Model for Analog Circuit Knowledge Learning to Validate the Dataset
|
| 17 |
+
This model is a fine-tuned version of `Qwen2.5-32B-Instruct` trained on a textual dataset for analog circuit knowledge learning.
|
| 18 |
+
* **Model Page**: [https://huggingface.co/analogllm/analog_model](https://huggingface.co/analogllm/analog_model)
|
| 19 |
+
* **Dataset Page**: [https://huggingface.co/datasets/analogllm/analog_data](https://huggingface.co/datasets/analogllm/analog_data)
|
| 20 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 21 |
|
| 22 |
## Model description
|
| 23 |
+
This model is fine-tuned on a textual dataset for analog circuit knowledge learning. The training dataset is constructed from high-quality textbooks using a knowledge distillation approach to extract structured question-answer pairs.
|
| 24 |
+
The model achieves **85.04% accuracy** on the AMSBench-TQA benchmark, showing a **15.67% improvement** over the initial Qwen2.5-32B-Instruct model.
|
| 25 |
|
| 26 |
+
## Limitations
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
While AnalogSeeker demonstrates strong performance on analog circuit knowledge evaluation benchmarks, it is specialized for this domain. Its applicability and performance in other, unrelated domains may be limited. Users should be aware that, like all language models, it may occasionally generate incorrect or nonsensical information, especially for highly novel or unrepresented concepts within its training data.
|
| 28 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
## Sample Usage
|
|
|
|
| 30 |
You can use this model with the Hugging Face `transformers` library:
|
| 31 |
|
| 32 |
```python
|
|
|
|
| 135 |
- Pytorch 2.5.1+cu124
|
| 136 |
- Datasets 3.6.0
|
| 137 |
- Tokenizers 0.21.1
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 138 |
```
|