metadata
name: duo
base_model: s-sahoo/duo
license: apache-2.0
pipeline_tag: text-generation
tasks: text-generation
language: en
datasets: Skylion007/openwebtext
Original Model Link : https://huggingface.co/s-sahoo/duo
name: duo
base_model: s-sahoo/duo
license: apache-2.0
pipeline_tag: text-generation
tasks: text-generation
language: en
datasets: Skylion007/openwebtext
Duo
Duo is a diffusion masked language model with 130m parameters. This repo makes the flash_attn and CUDA libraries optional so that all frameworks can be supported. Code for this model