|
|
| --- |
| language: en |
| license: mit |
| library_name: nanofm |
| tags: |
| - image-generation |
| - flow-matching |
| --- |
| |
| # nanoFlowMatching - ngromb/nanoFlowMatching-13M |
|
|
| This is a nano implementation of the DiT-LLaMA flow-matching model, trained on CIFAR-10 as part of the CS-503 course. |
|
|
| ## Model Description |
| The model consists of a transformer-based architecture that predicts the velocity field for flow matching. |
| It takes as input a noisy image, a timestep, and a class label, and outputs the predicted noise/velocity field. |
| The architecture includes adaptive layer norm modulation (AdaLN) for conditioning on both timestep and class labels. |
|
|
| ## Usage |
| You can load this model by adapting the DiT_Llama class from the `nanofm.modeling.dit` module, |
| to allow pretrained weights to be loaded from this repository. |
| |