Spaces:
Sleeping
Sleeping
File size: 782 Bytes
747cf48 25669cc 09774a9 25669cc 747cf48 25669cc 79c4404 747cf48 25669cc | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 | ---
title: BERT Metagenome Embeddings
emoji: 🧬
colorFrom: gray
colorTo: gray
sdk: docker
pinned: false
license: mit
short_description: Extract DNA sequence embeddings from pretrained BERT
---
# bert-embedding
Extract embeddings from DNA sequences using a BERT model pretrained on metagenomic sequences.
## Model
| | |
|---|---|
| architecture | BERT, 24 layers, 768 hidden, 12 heads |
| parameters | ~430M |
| input | DNA sequence (min 1000 bp) |
| output | 768-dim embedding |
| source | [genomenet/bert-metagenome](https://huggingface.co/genomenet/bert-metagenome) |
## Deployment
```bash
cd /vol/hpcprojects/pmuench/crispr_tool/bert-embedding
git add -A && git commit -m "update" && git push
```
## Acknowledgements
- BMBF de.NBI / GenomeNet
- DFG SPP 2141
- HZI BIFO
|