Update README.md
Browse files
README.md
CHANGED
|
@@ -10,24 +10,25 @@ tags:
|
|
| 10 |
---
|
| 11 |
# CoDA-v0-Instruct
|
| 12 |
|
| 13 |
-
## Overview
|
| 14 |
CoDA is Salesforce AI Research's open diffusion language model.
|
| 15 |
|
| 16 |
|
| 17 |
[Technical Report](https://github.com/SalesforceAIResearch/CoDA/blob/main/technical_report.pdf)
|
| 18 |
|
| 19 |
[Code](https://github.com/SalesforceAIResearch/CoDA/)
|
|
|
|
| 20 |
The code repo contains a unified training pipeline from pre-training to post-training, evaluation harnesses, and a simple Fast-API based serving backend.
|
| 21 |
|
| 22 |
|
| 23 |
-
## Requirements
|
| 24 |
```
|
| 25 |
torch==2.8.0
|
| 26 |
transformers>=4.47.1
|
| 27 |
flash-attn==2.8.3
|
| 28 |
```
|
| 29 |
|
| 30 |
-
## Quickstart
|
| 31 |
Here is a code snippet for loading the model, tokenizer and run generation.
|
| 32 |
```python
|
| 33 |
import torch
|
|
@@ -83,10 +84,10 @@ Comparison of code-generation performance across standard and plus-enhanced benc
|
|
| 83 |
|
| 84 |
|
| 85 |
|
| 86 |
-
## Deployment
|
| 87 |
Checkout our [Deployment Guide](https://github.com/SalesforceAIResearch/CoDA?tab=readme-ov-file#deployment-guide-%EF%B8%8F)!
|
| 88 |
|
| 89 |
-
## Citation
|
| 90 |
```
|
| 91 |
coming soon
|
| 92 |
```
|
|
|
|
| 10 |
---
|
| 11 |
# CoDA-v0-Instruct
|
| 12 |
|
| 13 |
+
## Overview 🎯
|
| 14 |
CoDA is Salesforce AI Research's open diffusion language model.
|
| 15 |
|
| 16 |
|
| 17 |
[Technical Report](https://github.com/SalesforceAIResearch/CoDA/blob/main/technical_report.pdf)
|
| 18 |
|
| 19 |
[Code](https://github.com/SalesforceAIResearch/CoDA/)
|
| 20 |
+
|
| 21 |
The code repo contains a unified training pipeline from pre-training to post-training, evaluation harnesses, and a simple Fast-API based serving backend.
|
| 22 |
|
| 23 |
|
| 24 |
+
## Requirements 📦
|
| 25 |
```
|
| 26 |
torch==2.8.0
|
| 27 |
transformers>=4.47.1
|
| 28 |
flash-attn==2.8.3
|
| 29 |
```
|
| 30 |
|
| 31 |
+
## Quickstart 🚀
|
| 32 |
Here is a code snippet for loading the model, tokenizer and run generation.
|
| 33 |
```python
|
| 34 |
import torch
|
|
|
|
| 84 |
|
| 85 |
|
| 86 |
|
| 87 |
+
## Deployment 🛠️
|
| 88 |
Checkout our [Deployment Guide](https://github.com/SalesforceAIResearch/CoDA?tab=readme-ov-file#deployment-guide-%EF%B8%8F)!
|
| 89 |
|
| 90 |
+
## Citation 📚
|
| 91 |
```
|
| 92 |
coming soon
|
| 93 |
```
|