metadata
language: en
license: mit
library_name: nanofm
tags:
- image-generation
- flow-matching
nanoFlowMatching - ngromb/nanoFlowMatching-13M
This is a nano implementation of the DiT-LLaMA flow-matching model, trained on CIFAR-10 as part of the CS-503 course.
Model Description
The model consists of a transformer-based architecture that predicts the velocity field for flow matching. It takes as input a noisy image, a timestep, and a class label, and outputs the predicted noise/velocity field. The architecture includes adaptive layer norm modulation (AdaLN) for conditioning on both timestep and class labels.
Usage
You can load this model by adapting the DiT_Llama class from the nanofm.modeling.dit module,
to allow pretrained weights to be loaded from this repository.