RaphaelMourad
/

ModernBERT-Codon-v1-34M

Model card Files Files and versions

RaphaelMourad commited on Mar 9, 2025

Commit

9cda6db

·

verified ·

1 Parent(s): cebd84d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -10,7 +10,7 @@ tags:
 # Model Card for ModerBert-Codon-v1-34M (Mistral for coding DNA)
 The ModerBert-Codon-v1-34M Large Language Model (LLM) is a pretrained generative DNA sequence model with 34M parameters.
-It is derived from Mixtral-8x7B-v0.1 model, which was simplified for DNA: the number of layers and the hidden size were reduced.
 The model was pretrained using 24M coding DNA sequences (3000bp) from many different species (vertebrates, plants, bacteria, viruses, ...).

 # Model Card for ModerBert-Codon-v1-34M (Mistral for coding DNA)
 The ModerBert-Codon-v1-34M Large Language Model (LLM) is a pretrained generative DNA sequence model with 34M parameters.
+It is derived from ModernBERT model, which was simplified for DNA: the number of layers and the hidden size were reduced.
 The model was pretrained using 24M coding DNA sequences (3000bp) from many different species (vertebrates, plants, bacteria, viruses, ...).