Instructions to use Salesforce/codet5p-2b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Salesforce/codet5p-2b with Transformers:
# Load model directly from transformers import AutoModelForSeq2SeqLM model = AutoModelForSeq2SeqLM.from_pretrained("Salesforce/codet5p-2b", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Commit ·
a9b9968
1
Parent(s): a191f78
adds no_split_modules
Browse filesAdds _no_split_modules attribute on the EncoderDecoder class for accelerate support
- modeling_codet5p.py +1 -0
modeling_codet5p.py
CHANGED
|
@@ -758,6 +758,7 @@ def shift_tokens_right(input_ids: torch.Tensor, pad_token_id: int, decoder_start
|
|
| 758 |
# Adapted from transformers.models.encoder_decoder.modeling_encoder_decoder.EncoderDecoderModel
|
| 759 |
class CodeT5pEncoderDecoderModel(PreTrainedModel):
|
| 760 |
config_class = CodeT5pConfig
|
|
|
|
| 761 |
|
| 762 |
def __init__(
|
| 763 |
self,
|
|
|
|
| 758 |
# Adapted from transformers.models.encoder_decoder.modeling_encoder_decoder.EncoderDecoderModel
|
| 759 |
class CodeT5pEncoderDecoderModel(PreTrainedModel):
|
| 760 |
config_class = CodeT5pConfig
|
| 761 |
+
_no_split_modules = ["CodeT5pBlock"]
|
| 762 |
|
| 763 |
def __init__(
|
| 764 |
self,
|