| | --- |
| | license: mit |
| | pipeline_tag: text-generation |
| | --- |
| | # Advanced FastText Modification |
| | colab:https://colab.research.google.com/drive/1apd0UFutEqBMG_7t_60QJAoxWxNdc1yr#scrollTo=GayYJ9VeJms7 |
| | ## Overview |
| | This software is an **innovative version of FastText**, optimized to use its classification system for **fast and efficient word prediction**. With capabilities that can surpass modern language models, it delivers exceptional performance. |
| |
|
| | ## Model Training |
| | - **Data Used:** The models were trained with more than **20,000 question and answer (QA) interactions** from the **Wizard Evo instruct** dataset. |
| | - **Focus on Dynamic Learning:** This approach guarantees in-depth understanding in contexts of dialogue and interaction. |
| |
|
| | ## Processing Capacity |
| | - **Speed:** 800 tokens/thread/second. |
| | - **Performance on Common Hardware:** On a notebook with 16 threads, the program processes approximately **50 billion tokens per hour**. |
| |
|
| | ## Learning and Testing |
| | - **Learning:** Evidence points to an ability to **learn robustly**. |
| | - **Testing:** The software is still in the early testing phases, but preliminary results are promising. |
| |
|
| | --- |
| |
|
| | This project is constantly evolving and we welcome any feedback or contributions from the community! |
