gr8monk3ys commited on
Commit
5b85522
·
verified ·
1 Parent(s): 2be4558

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +40 -16
README.md CHANGED
@@ -12,6 +12,14 @@ metrics:
12
  - accuracy
13
  - f1
14
  pipeline_tag: text-classification
 
 
 
 
 
 
 
 
15
  ---
16
 
17
  # Academic Paper Classifier
@@ -36,16 +44,21 @@ acceptance or funding allocation.
36
 
37
  ## Labels
38
 
39
- | Id | Label | Description |
40
- |----|----------|-----------------------------------|
41
- | 0 | cs.AI | Artificial Intelligence |
42
- | 1 | cs.CL | Computation and Language (NLP) |
43
- | 2 | cs.CV | Computer Vision |
44
- | 3 | cs.LG | Machine Learning |
45
- | 4 | cs.NE | Neural and Evolutionary Computing |
46
- | 5 | cs.RO | Robotics |
47
- | 6 | math.ST | Statistics Theory |
48
- | 7 | stat.ML | Machine Learning (Statistics) |
 
 
 
 
 
49
 
50
  ## Training Procedure
51
 
@@ -77,8 +90,19 @@ language-understanding performance.
77
 
78
  ### Metrics
79
 
80
- The model is evaluated on accuracy, weighted F1, weighted precision, and
81
- weighted recall. The best checkpoint is selected by weighted F1.
 
 
 
 
 
 
 
 
 
 
 
82
 
83
  ## How to Use
84
 
@@ -89,7 +113,7 @@ from transformers import pipeline
89
 
90
  classifier = pipeline(
91
  "text-classification",
92
- model="gr8monk3ys/paper-classifier-model",
93
  )
94
 
95
  abstract = (
@@ -100,14 +124,14 @@ abstract = (
100
 
101
  result = classifier(abstract)
102
  print(result)
103
- # [{'label': 'cs.CL', 'score': 0.95}]
104
  ```
105
 
106
  ### With the included inference script
107
 
108
  ```bash
109
  python inference.py \
110
- --model_path gr8monk3ys/paper-classifier-model \
111
  --abstract "We propose a convolutional neural network for image recognition..."
112
  ```
113
 
@@ -141,6 +165,6 @@ If you use this model in your research, please cite:
141
  title = {Academic Paper Classifier},
142
  author = {Lorenzo Scaturchio},
143
  year = {2025},
144
- url = {https://huggingface.co/gr8monk3ys/paper-classifier-model}
145
  }
146
  ```
 
12
  - accuracy
13
  - f1
14
  pipeline_tag: text-classification
15
+ language:
16
+ - en
17
+ library_name: transformers
18
+ widget:
19
+ - text: "We introduce a novel attention mechanism that reduces the quadratic complexity of transformers to linear time while preserving accuracy on long-context language modeling benchmarks."
20
+ example_title: ML paper abstract
21
+ - text: "We present a distributed consensus protocol that tolerates Byzantine faults with optimal message complexity in partially synchronous networks."
22
+ example_title: Systems paper abstract
23
  ---
24
 
25
  # Academic Paper Classifier
 
44
 
45
  ## Labels
46
 
47
+ The label space comes from [ccdv/arxiv-classification](https://huggingface.co/datasets/ccdv/arxiv-classification) (11 classes):
48
+
49
+ | Id | Label | Description |
50
+ |----|---------|------------------------------------|
51
+ | 0 | math.AC | Commutative Algebra |
52
+ | 1 | cs.CV | Computer Vision |
53
+ | 2 | cs.AI | Artificial Intelligence |
54
+ | 3 | cs.SY | Systems and Control |
55
+ | 4 | math.GR | Group Theory |
56
+ | 5 | cs.CE | Computational Engineering |
57
+ | 6 | cs.PL | Programming Languages |
58
+ | 7 | cs.IT | Information Theory |
59
+ | 8 | cs.DS | Data Structures and Algorithms |
60
+ | 9 | cs.NE | Neural and Evolutionary Computing |
61
+ | 10 | math.ST | Statistics Theory |
62
 
63
  ## Training Procedure
64
 
 
90
 
91
  ### Metrics
92
 
93
+ Measured on 1,500 held-out validation papers (run of 2026-07-12; 8,000
94
+ training samples, 3 epochs, max_length 384, transformers 5.13):
95
+
96
+ | Metric | Score |
97
+ |--------|-------|
98
+ | Accuracy | 0.829 |
99
+ | F1 (weighted) | 0.827 |
100
+ | Precision (weighted) | 0.828 |
101
+ | Recall (weighted) | 0.829 |
102
+
103
+ The best checkpoint is selected by weighted F1. Note the model saw the
104
+ first 8,000 of ~28k training documents truncated to 384 tokens; training
105
+ on the full corpus at 512 tokens should improve these numbers.
106
 
107
  ## How to Use
108
 
 
113
 
114
  classifier = pipeline(
115
  "text-classification",
116
+ model="gr8monk3ys/paper-classifier",
117
  )
118
 
119
  abstract = (
 
124
 
125
  result = classifier(abstract)
126
  print(result)
127
+ # [{'label': 'cs.NE', 'score': 0.61}]
128
  ```
129
 
130
  ### With the included inference script
131
 
132
  ```bash
133
  python inference.py \
134
+ --model_path gr8monk3ys/paper-classifier \
135
  --abstract "We propose a convolutional neural network for image recognition..."
136
  ```
137
 
 
165
  title = {Academic Paper Classifier},
166
  author = {Lorenzo Scaturchio},
167
  year = {2025},
168
+ url = {https://huggingface.co/gr8monk3ys/paper-classifier}
169
  }
170
  ```