metadata
library_name: transformers
tags:
- From_Scratch
- Custom
- YSNRFD
- SLM
- ysnrfd
- Persian_SLM
datasets:
- ysn-rfd/fibonacci_alpaca_to_sharegpt_gpt_format_convert_new_dataset_release
language:
- fa
Model Details
WARNINNGS: This Model IS Pre-Trained, in the future will be finetuned.
Model Description
The First Persian SLM By YSNRFD, This Model support Only Persian text Inputs, In The Future I Want Add Englih Language Support.
- Developed by: ysnrfd
- Funded by: ysnrfd
- Shared by: ysnrfd
- Model type: SLM
- Language(s) (NLP): Persian
- License: ysnrfd LICENSE
Training Data
ysnrfd Sample Persian Text LINK: https://huggingface.co/datasets/ysn-rfd/fibonacci_alpaca_to_sharegpt_gpt_format_convert_new_dataset_release
Training Hyperparameters
- Training regime: fp32 mixed precision
Evaluation
Not Yet
Testing Data, Factors & Metrics
ysnrfd Sample Persian Text
Testing Data
Not Yet
Summary
The Fisrt Persian SLM Trained From Scratch
- Hardware Type: Nvidia P100
- Hours used: 21H
- Cloud Provider: Kaggle
Model Architecture and Objective
YSNRFD Architecture
Hardware
Nvidia P100
Software
Python Code, From Scratch, Pytorch