| --- |
| library_name: peft |
| license: apache-2.0 |
| language: |
| - en |
| pipeline_tag: text-generation |
| tags: |
| - fine-tuned |
| inference: |
| parameters: |
| temperature: 0.7 |
| --- |
| ## Training procedure |
| The TSOTSALLM-beta Large Language Model (LLM) is a fine-tuned generative text model based on LLama-2 with 7 billions parameters. |
|
|
| ## Model Architecture |
| TSOTSALLM-beta is a transformer model, with the following architecture choices: |
| - Grouped-Query Attention |
| - Sliding-Window Attention |
| - Byte-fallback BPE tokenizer |
| ## The TSOTSALLM AI Team |
| - Jean Petit BIKIM |
| - Fidel Jiomekong |
| - Martins Folefack |
| - Brice |
