|
|
--- |
|
|
name: duo |
|
|
base_model: s-sahoo/duo |
|
|
license: apache-2.0 |
|
|
pipeline_tag: text-generation |
|
|
tasks: text-generation |
|
|
language: en |
|
|
datasets: Skylion007/openwebtext |
|
|
--- |
|
|
> [!IMPORTANT] |
|
|
> Original Model Link : [https://huggingface.co/s-sahoo/duo](https://huggingface.co/s-sahoo/duo) |
|
|
> |
|
|
|
|
|
``` |
|
|
name: duo |
|
|
base_model: s-sahoo/duo |
|
|
license: apache-2.0 |
|
|
pipeline_tag: text-generation |
|
|
tasks: text-generation |
|
|
language: en |
|
|
datasets: Skylion007/openwebtext |
|
|
``` |
|
|
# Duo |
|
|
Duo is a diffusion masked language model with 130m parameters. This repo makes the `flash_attn` and CUDA libraries optional so that all frameworks can be supported. [Code for this model](https://github.com/s-sahoo/duo) |
|
|
|
