hubentu/genemodel-bulk-v0

Model summary

genemodel-bulk is a pre-trained foundation model built on the Longformer framework. It has been trained on large-scale microarray and bulk RNA-Seq datasets. The model functions as an embedding tool for feature extraction and can be fine-tuned for phenotype-related regression and classification tasks.

Usage

from transformers import AutoTokenizer, AutoModel
model = AutoModel.from_pretrained('hubentu/genemodel-bulk-v0')
tokenizer = AutoTokenizer.from_pretrained('hubentu/genemodel-bulk-v0')

embd=pipeline("feature-extraction", model=model, tokenizer=tokenizer)
embd("ENSG00000169885 ENSG00000241599 ...")