Instructions to use vinai/phobert-large with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use vinai/phobert-large with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="vinai/phobert-large")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("vinai/phobert-large") model = AutoModelForMaskedLM.from_pretrained("vinai/phobert-large", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -21,4 +21,4 @@ The general architecture and experimental results of PhoBERT can be found in our
|
|
| 21 |
|
| 22 |
**Please CITE** our paper when PhoBERT is used to help produce published results or is incorporated into other software.
|
| 23 |
|
| 24 |
-
|
|
|
|
| 21 |
|
| 22 |
**Please CITE** our paper when PhoBERT is used to help produce published results or is incorporated into other software.
|
| 23 |
|
| 24 |
+
_Users may also want to use [BamiBERT](https://huggingface.co/Qualcomm-AI-Research/BamiBERT), our new BERT-based pretrained language model for Vietnamese that addresses key limitations of PhoBERT. Trained from scratch on a 129 GB corpus of general-domain Vietnamese text for 20 epochs, [BamiBERT](https://huggingface.co/Qualcomm-AI-Research/BamiBERT) supports an extended context length of up to 2,048 tokens and operates directly on raw input, eliminating the need for external word segmentation. Across eight Vietnamese benchmarks, it achieves the best performance on 11 of 15 metrics and the second-best performance on three others, setting a new state of the art among "base"-sized Vietnamese encoders and demonstrating strong cross-domain generalization._
|