File size: 663 Bytes
eb94961
c5c1f62
 
eb94961
 
c5c1f62
 
 
eb94961
c5c1f62
 
 
eb94961
 
c5c1f62
 
 
 
 
 
 
eb94961
c5c1f62
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
---
name: duo
base_model: s-sahoo/duo
license: apache-2.0
pipeline_tag: text-generation
tasks: text-generation
language: en
datasets: Skylion007/openwebtext
---
> [!IMPORTANT]
> Original Model Link : [https://huggingface.co/s-sahoo/duo](https://huggingface.co/s-sahoo/duo)
> 

```
name: duo
base_model: s-sahoo/duo
license: apache-2.0
pipeline_tag: text-generation
tasks: text-generation
language: en
datasets: Skylion007/openwebtext
```
# Duo
Duo is a diffusion masked language model with 130m parameters. This repo makes the `flash_attn` and CUDA libraries optional so that all frameworks can be supported. [Code for this model](https://github.com/s-sahoo/duo)