Spaces:
Runtime error
Runtime error
Dhairyashil Ghatage commited on
Commit ·
75e3cfa
1
Parent(s): 251429f
remove mlx dependancy
Browse files- README.md +4 -1
- requirements.txt +5 -4
README.md
CHANGED
|
@@ -20,7 +20,6 @@ This project demonstrates a chatbot implementation using:
|
|
| 20 |
- [Gradio](https://gradio.app) for the user interface
|
| 21 |
- [Microsoft's Phi-2 model](https://huggingface.co/microsoft/phi-2) as the base language model
|
| 22 |
- [OpenAssistant Conversations Dataset (OASST1)](https://huggingface.co/datasets/OpenAssistant/oasst1) for fine-tuning
|
| 23 |
-
- GenAI code assistant
|
| 24 |
|
| 25 |
## Fine-tuning
|
| 26 |
|
|
@@ -28,6 +27,10 @@ The model was fine-tuned using the QLoRA (Quantized Low-Rank Adaptation) techniq
|
|
| 28 |
|
| 29 |
Credit for the fine-tuning process goes to the excellent guide by [Deltaaruna](https://medium.com/rahasak/fine-tune-llms-on-your-pc-with-qlora-apple-mlx-c2aedf1f607d).
|
| 30 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
## License
|
| 32 |
|
| 33 |
MIT
|
|
|
|
| 20 |
- [Gradio](https://gradio.app) for the user interface
|
| 21 |
- [Microsoft's Phi-2 model](https://huggingface.co/microsoft/phi-2) as the base language model
|
| 22 |
- [OpenAssistant Conversations Dataset (OASST1)](https://huggingface.co/datasets/OpenAssistant/oasst1) for fine-tuning
|
|
|
|
| 23 |
|
| 24 |
## Fine-tuning
|
| 25 |
|
|
|
|
| 27 |
|
| 28 |
Credit for the fine-tuning process goes to the excellent guide by [Deltaaruna](https://medium.com/rahasak/fine-tune-llms-on-your-pc-with-qlora-apple-mlx-c2aedf1f607d).
|
| 29 |
|
| 30 |
+
## Usage
|
| 31 |
+
|
| 32 |
+
This app runs on CPU and uses Hugging Face's Transformers library for inference. It's designed to be compatible with various environments, including the Hugging Face Spaces platform.
|
| 33 |
+
|
| 34 |
## License
|
| 35 |
|
| 36 |
MIT
|
requirements.txt
CHANGED
|
@@ -1,4 +1,5 @@
|
|
| 1 |
-
|
| 2 |
-
|
| 3 |
-
|
| 4 |
-
|
|
|
|
|
|
| 1 |
+
torch==2.0.1
|
| 2 |
+
transformers==4.31.0
|
| 3 |
+
gradio==4.36.1
|
| 4 |
+
huggingface_hub
|
| 5 |
+
accelerate
|