|
|
--- |
|
|
library_name: transformers |
|
|
tags: [] |
|
|
--- |
|
|
|
|
|
# gemma2-mitra-base |
|
|
|
|
|
This is based on gemma2-9b and continously pretrained for 2 epochs on a total of 7B tokens from various Buddhist data collections preserved in Sanskrit, Tibetan, English, and Pāli. |
|
|
A publication describing the dataset and training details will follow soon. |
|
|
|
|
|
## Model Details |
|
|
For details on how to run this please see the gemma2-9b repository: https://huggingface.co/google/gemma-2-9b |
|
|
Please be aware that this is a base model without any instruction finetuning, so it will perform badly on general tasks without giving at least few-shot examples. |
|
|
There is an instruction-finetuned version here: https://huggingface.co/buddhist-nlp/gemma-2-mitra-it |
