Hugging Face's logo

junnyu
/
roformer_small_generator

Fill-Mask
Transformers
PyTorch
English
roformer
electra
masked-lm
rotary position embedding
Model card Files
xet
 Community
2
junnyu commited on
Commit
15acd19
·
1 Parent(s): d528ac3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -6
README.md CHANGED
@@ -27,18 +27,17 @@ datasets:
27
  - GPU RTX3090
28
  - 训练时间总共耗费55h
29
 
30
- ### wandb日志
31
- [预训练日志](https://wandb.ai/junyu/electra_rotary_small_pretrain?workspace=user-junyu)
 
32
 
33
- [GLUE微调日志](https://wandb.ai/junyu/electra_rotary_glue_100?workspace=user-junyu)
34
-
35
- # 四、安装
36
  ```bash
37
  pip install roformer
38
  或
39
  pip install git+https://github.com/JunnYu/RoFormer_pytorch.git
40
  ```
41
- # 五、 使用
42
  ```python
43
  import torch
44
  from roformer import RoFormerForMaskedLM
 
27
  - GPU RTX3090
28
  - 训练时间总共耗费55h
29
 
30
+ # 四、wandb日志
31
+ - [**预训练日志**](https://wandb.ai/junyu/electra_rotary_small_pretrain?workspace=user-junyu)
32
+ - [**GLUE微调日志**](https://wandb.ai/junyu/electra_rotary_glue_100?workspace=user-junyu)
33
 
34
+ # 五、安装
 
 
35
  ```bash
36
  pip install roformer
37
  或
38
  pip install git+https://github.com/JunnYu/RoFormer_pytorch.git
39
  ```
40
+ # 六、 使用
41
  ```python
42
  import torch
43
  from roformer import RoFormerForMaskedLM