File size: 1,074 Bytes
4545bf0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
---
language: en
license: mit
tags:
- scibert
- classification
- technical-papers
- machine-learning
---

# AEGIS SciBERT Technical Classifier

## Model Description
Fine-tuned SciBERT model for classifying technical papers into research categories.

## Training Details
- **Base Model**: allenai/scibert_scivocab_uncased
- **Training Samples**: 500
- **Number of Classes**: 6
- **Classes**: cs.AI, cs.LG, quant-ph, cs.NE, stat.ML, cs.CV
- **Validation Accuracy**: 1.0000

## Usage
```python
from transformers import AutoModelForSequenceClassification, AutoTokenizer

model = AutoModelForSequenceClassification.from_pretrained("gsstec/aegis-scibert-technical")
tokenizer = AutoTokenizer.from_pretrained("gsstec/aegis-scibert-technical")

# Example inference
text = "Quantum computing algorithms for machine learning"
inputs = tokenizer(text, return_tensors="pt")
outputs = model(**inputs)
predictions = torch.softmax(outputs.logits, dim=-1)
```

## Classes
- `cs.AI`: Class 0
- `cs.LG`: Class 1
- `quant-ph`: Class 2
- `cs.NE`: Class 3
- `stat.ML`: Class 4
- `cs.CV`: Class 5