Protein Language Models
Collection
Finetuned various pretrained protein language models • 2 items • Updated
Ankh Base ConvBERT Q3
This model is a downstream Q3 secondary structure prediction head trained on frozen Ankh Base embeddings.
Architecture
- Frozen backbone: Ankh Base
- Downstream head: ConvBERTForMultiClassClassification
- Input dim: 768
- Hidden dim: 384
- Attention heads: 4
- Kernel size: 7
- Dropout: 0.2
Training Status
- Last completed epoch: 5
- Best validation Q3 accuracy: 0.4803939766583911
Important Note
This repository contains only the downstream head. For inference, load Ankh Base first, extract embeddings, then pass the embeddings to this head.
- Downloads last month
- 5
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for joanitolopo/ankh-base-convbert-q3
Base model
ElnaggarLab/ankh-base