Model usage?
Can you please expand the examples of how to use the model? The examples given are partial (and based on the modelGen package), it doesn't include how to work with new data/labels/etc.
Or can we simply load them as a normal/standard HF compatible model?
Thanks!
Hi @GrimSqueaker ,
We only directly support model usage through ModelGenerator. Here is documentation to help with the use-cases you mentioned
- https://genbio-ai.github.io/ModelGenerator/experiment_design/datafiles/
- https://genbio-ai.github.io/ModelGenerator/quick_start/
I don't recommend it, but if you strongly prefer the HF interface the model is HF-native and can be used with AutoModel, AutoConfig, AutoTokenizer, etc.
I advise against this because ModelGenerator automatically handles many of the issues of working with pretrained models and makes adapting them for new tasks/data much simpler, but if you prefer to handle these issues manually you can take a look at the models' associated backbone to see how we load and use the model in ModelGenerator.
I want to try using the model with other heads, pretraining tasks and libraries (e.g . sentence transformers); is the ModelGenerator take compatible with all those?
It should be, although you would need to look into implementing a task and adapter the same way you might implement a training script or head with HF.
We are also working on supporting HF usage directly. While it's still in development, I believe you would be able to copy-paste or slightly modify the code we use to load the AIDO.DNA model using HF within the modelgenerator backbone wrapper. Let me know if you run into issues in the meantime.
https://github.com/genbio-ai/ModelGenerator/blob/main/modelgenerator/backbones/backbones.py#L76-L122