---
name: duo
base_model: s-sahoo/duo
license: apache-2.0
pipeline_tag: text-generation
tasks: text-generation
language: en
datasets: Skylion007/openwebtext
---
> [!IMPORTANT]
> Original Model Link : [https://huggingface.co/s-sahoo/duo](https://huggingface.co/s-sahoo/duo)
> 

```
name: duo
base_model: s-sahoo/duo
license: apache-2.0
pipeline_tag: text-generation
tasks: text-generation
language: en
datasets: Skylion007/openwebtext
```
# Duo
Duo is a diffusion masked language model with 130m parameters. This repo makes the `flash_attn` and CUDA libraries optional so that all frameworks can be supported. [Code for this model](https://github.com/s-sahoo/duo)