Dhairyashil Ghatage commited on
Commit
75e3cfa
·
1 Parent(s): 251429f

remove mlx dependancy

Browse files
Files changed (2) hide show
  1. README.md +4 -1
  2. requirements.txt +5 -4
README.md CHANGED
@@ -20,7 +20,6 @@ This project demonstrates a chatbot implementation using:
20
  - [Gradio](https://gradio.app) for the user interface
21
  - [Microsoft's Phi-2 model](https://huggingface.co/microsoft/phi-2) as the base language model
22
  - [OpenAssistant Conversations Dataset (OASST1)](https://huggingface.co/datasets/OpenAssistant/oasst1) for fine-tuning
23
- - GenAI code assistant
24
 
25
  ## Fine-tuning
26
 
@@ -28,6 +27,10 @@ The model was fine-tuned using the QLoRA (Quantized Low-Rank Adaptation) techniq
28
 
29
  Credit for the fine-tuning process goes to the excellent guide by [Deltaaruna](https://medium.com/rahasak/fine-tune-llms-on-your-pc-with-qlora-apple-mlx-c2aedf1f607d).
30
 
 
 
 
 
31
  ## License
32
 
33
  MIT
 
20
  - [Gradio](https://gradio.app) for the user interface
21
  - [Microsoft's Phi-2 model](https://huggingface.co/microsoft/phi-2) as the base language model
22
  - [OpenAssistant Conversations Dataset (OASST1)](https://huggingface.co/datasets/OpenAssistant/oasst1) for fine-tuning
 
23
 
24
  ## Fine-tuning
25
 
 
27
 
28
  Credit for the fine-tuning process goes to the excellent guide by [Deltaaruna](https://medium.com/rahasak/fine-tune-llms-on-your-pc-with-qlora-apple-mlx-c2aedf1f607d).
29
 
30
+ ## Usage
31
+
32
+ This app runs on CPU and uses Hugging Face's Transformers library for inference. It's designed to be compatible with various environments, including the Hugging Face Spaces platform.
33
+
34
  ## License
35
 
36
  MIT
requirements.txt CHANGED
@@ -1,4 +1,5 @@
1
- huggingface_hub==0.22.2
2
- mlx>=0.0.7
3
- transformers
4
- numpy
 
 
1
+ torch==2.0.1
2
+ transformers==4.31.0
3
+ gradio==4.36.1
4
+ huggingface_hub
5
+ accelerate