analogllm commited on
Commit
4aa5657
·
verified ·
1 Parent(s): b77a007

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -42
README.md CHANGED
@@ -9,45 +9,24 @@ tags:
9
  - analog-circuit-design
10
  pipeline_tag: text-generation
11
  model-index:
12
- - name: AnalogSeeker (Qwen2.5-32B-Instruct_nsc-sft)
13
  results: []
14
  ---
15
 
16
- # AnalogSeeker: An Open-source Foundation Language Model for Analog Circuit Design
 
 
 
17
 
18
- This model, `AnalogSeeker_2025_07_10_3`, is a fine-tuned version of `Qwen2.5-32B-Instruct`. It was presented in the paper [AnalogSeeker: An Open-source Foundation Language Model for Analog Circuit Design](https://huggingface.co/papers/2508.10409).
19
-
20
- * **Project Page**: [https://huggingface.co/analogllm/analogseeker](https://huggingface.co/analogllm/analogseeker)
21
- * **GitHub Repository**: [https://github.com/analogllm/AnalogSeeker](https://github.com/analogllm/AnalogSeeker)
22
 
23
  ## Model description
 
 
24
 
25
- AnalogSeeker is an open-source foundation language model specifically developed for analog circuit design. Its primary objective is to integrate specialized domain knowledge and provide design assistance in this complex field. To address the inherent scarcity of data in analog circuit design, AnalogSeeker employs a unique corpus collection strategy: high-quality, accessible textbooks across relevant subfields are systematically curated and cleaned into a textual domain corpus.
26
-
27
- The model introduces a granular domain knowledge distillation method where raw, unlabeled domain corpus is decomposed into typical, granular learning nodes. A multi-agent framework is then utilized to distill implicit knowledge embedded in unstructured text into detailed question-answer data pairs, complete with detailed reasoning processes. This yields a fine-grained, learnable dataset used for fine-tuning. AnalogSeeker explores and shares novel training methods, establishing a fine-tuning-centric training paradigm and implementing a neighborhood self-constrained supervised fine-tuning algorithm to enhance training outcomes by constraining the perturbation magnitude between the model's output distributions.
28
-
29
- ## Intended uses & limitations
30
-
31
- **Intended Uses:**
32
- AnalogSeeker is intended for research use in the field of analog circuit design. It aims to:
33
- * Integrate domain knowledge for analog circuits.
34
- * Provide design assistance and answer domain-specific questions.
35
- * Support tasks such as operational amplifier design.
36
- * Serve as a foundation for further research and development in analog circuit LLMs.
37
-
38
- **Limitations:**
39
  While AnalogSeeker demonstrates strong performance on analog circuit knowledge evaluation benchmarks, it is specialized for this domain. Its applicability and performance in other, unrelated domains may be limited. Users should be aware that, like all language models, it may occasionally generate incorrect or nonsensical information, especially for highly novel or unrepresented concepts within its training data.
40
 
41
- ## Training and evaluation data
42
-
43
- **Training Data:**
44
- The model was trained on a meticulously collected corpus based on the domain knowledge framework of analog circuits. This corpus consists of high-quality, accessible textbooks across relevant subfields, systematically curated and cleaned. A granular domain knowledge distillation method was applied, where raw text was decomposed into learning nodes, and a multi-agent framework distilled implicit knowledge into question-answer data pairs with detailed reasoning for fine-tuning.
45
-
46
- **Evaluation Data and Performance:**
47
- AnalogSeeker was evaluated on AMSBench-TQA, the analog circuit knowledge evaluation benchmark. It achieved **85.04% accuracy**, marking a significant **15.67% point improvement** over the original Qwen2.5-32B-Instruct model and demonstrating competitive performance with mainstream commercial models.
48
-
49
  ## Sample Usage
50
-
51
  You can use this model with the Hugging Face `transformers` library:
52
 
53
  ```python
@@ -156,17 +135,4 @@ The following hyperparameters were used during training:
156
  - Pytorch 2.5.1+cu124
157
  - Datasets 3.6.0
158
  - Tokenizers 0.21.1
159
-
160
- ## Citation
161
-
162
- If you find AnalogSeeker useful in your research, please consider citing the original paper:
163
-
164
- ```bibtex
165
- @article{analogseeker2025,
166
- title={AnalogSeeker: An Open-source Foundation Language Model for Analog Circuit Design},
167
- author={AnalogSeeker Team}, # Author information not provided in the prompt's paper details, so a placeholder like 'AnalogSeeker Team' or 'Anonymous' is often used if no specific author list is given. In this case, 'AnalogSeeker Team' seems appropriate from the context.
168
- journal={arXiv preprint arXiv:2508.10409},
169
- year={2025}, # Year not directly stated, assuming from the paper ID 2508.10409 which implies 2025.
170
- url={https://huggingface.co/papers/2508.10409},
171
- }
172
  ```
 
9
  - analog-circuit-design
10
  pipeline_tag: text-generation
11
  model-index:
12
+ - name: "to be named"
13
  results: []
14
  ---
15
 
16
+ # A Fine-tuned Model for Analog Circuit Knowledge Learning to Validate the Dataset
17
+ This model is a fine-tuned version of `Qwen2.5-32B-Instruct` trained on a textual dataset for analog circuit knowledge learning.
18
+ * **Model Page**: [https://huggingface.co/analogllm/analog_model](https://huggingface.co/analogllm/analog_model)
19
+ * **Dataset Page**: [https://huggingface.co/datasets/analogllm/analog_data](https://huggingface.co/datasets/analogllm/analog_data)
20
 
 
 
 
 
21
 
22
  ## Model description
23
+ This model is fine-tuned on a textual dataset for analog circuit knowledge learning. The training dataset is constructed from high-quality textbooks using a knowledge distillation approach to extract structured question-answer pairs.
24
+ The model achieves **85.04% accuracy** on the AMSBench-TQA benchmark, showing a **15.67% improvement** over the initial Qwen2.5-32B-Instruct model.
25
 
26
+ ## Limitations
 
 
 
 
 
 
 
 
 
 
 
 
 
27
  While AnalogSeeker demonstrates strong performance on analog circuit knowledge evaluation benchmarks, it is specialized for this domain. Its applicability and performance in other, unrelated domains may be limited. Users should be aware that, like all language models, it may occasionally generate incorrect or nonsensical information, especially for highly novel or unrepresented concepts within its training data.
28
 
 
 
 
 
 
 
 
 
29
  ## Sample Usage
 
30
  You can use this model with the Hugging Face `transformers` library:
31
 
32
  ```python
 
135
  - Pytorch 2.5.1+cu124
136
  - Datasets 3.6.0
137
  - Tokenizers 0.21.1
 
 
 
 
 
 
 
 
 
 
 
 
 
138
  ```