Update geneformer/evaluation_utils.py to be compatible with different versions of the datasets package.

add input_identifier to tokenize specific matched files

plot umap for all labels in same view

Update README.md

silence tensor copy warning

clone rather than wrap tensors

update collator with dummy save fn for transformers compatibility

fix to properly move model after checking device

move model to device after checking

update V1 token dict usage to self attr

move V1 autoformatting to after validate_options

add option for relabeling data from prior label class dict, update dict paths in manifest

delete first version of dist multitask example

update dist multitask example name

Add example notebook for distributed multi-task cell classification (#543)

specify bitsandbites version

add V2 models

update with V2 models

edit docs to remove backend isp functions

fix TypeError: TrainingArguments.__init__() got an unexpected keyword argument 'evaluation_strategy' (#539)

add fallback task_type for LoraConfig to support different PEFT versions (#538)

update eval_strategy for new transformers version

move import wandb to conditional

fully qualified imports to resolve name-space conflicts (#532)

ddp_mtl_nccl_support (#524)

edit imports in perturber_utils

fix exact_mean subselection to be for index rather than col name

fix exact_mean and exact_median to subselect dataframe emb cols, not cell rows

add quantization for pretrained model

Prepare data cell level pass cell state dict instead of genes (#483)

ensure gene class dict only inverted when using gene classifier

make plot roc compatible with eval-only metrics

Merge remote-tracking branch 'origin/main'

fix gene class dict labeling

Fix how mappings and train and val data are returned (#473)

Upload gene_name_id_dict_gc95M.pkl (#470)

Add checks for custom attributes and n_counts prior to sum ensembl id (#461)

further emphasize different token dictionaries in examples

remove unused imports while no longer using distributed sampler

Raise error for train and validation mismatch (#459)

Upload in_silico_perturber.py (#432)

Update geneformer/emb_extractor.py (#453)

Update geneformer/tokenizer.py (#450)

update isp default mode to cls

Adding tags to the model (#448)

update transformers version to match pretrainer using accelerate

update pretrainer to not use distributed sampler (Trainer uses accelerate)

update function for N_Detections for mixture_model without anchor_token

add check to ensure emb_label is None for getting state embs dict

change default emb to cls