Spaces:
Sleeping
Sleeping
Commit
·
3209fc4
1
Parent(s):
df0e34d
update readme
Browse files
README.md
CHANGED
|
@@ -10,28 +10,32 @@ pinned: false
|
|
| 10 |
---
|
| 11 |
|
| 12 |
# LLM From Scratch
|
|
|
|
| 13 |
_Ibrahim Khalid_
|
| 14 |
|
| 15 |
-
The hosted project is available on [HuggingFace](https://huggingface.co/spaces/ibrahimmkhalid/llm-from-scratch)
|
| 16 |
|
| 17 |
The purpose of this project is to build a simple large language model from scratch.
|
| 18 |
|
| 19 |
-
|
| 20 |
This repo is following the guide from https://www.youtube.com/watch?v=UU1WVnMk4E8
|
| 21 |
|
| 22 |
In this repo:
|
| 23 |
-
- ./shakespeare.txt - This is a sample text used for training a smaller scale model
|
| 24 |
-
- ./bigram_testing.sync.ipynb - This notebook is where I test a basic BiGram model
|
| 25 |
-
- ./gpt_shakespeare.sync.ipynb - Notebook implementing simple GPT model using entire works of shakespeare
|
| 26 |
-
- ./gpt_openwebtext.sync.ipynb - Notebook implementing GPT model based on the [OpenWebText Corpus](https://skylion007.github.io/OpenWebTextCorpus/)
|
| 27 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 28 |
|
| 29 |
### Prepare environment
|
|
|
|
| 30 |
```
|
| 31 |
-
pip install -r ./requirements
|
| 32 |
-
pip install -r ./requirements
|
| 33 |
```
|
|
|
|
| 34 |
---
|
| 35 |
-
|
|
|
|
| 36 |
|
| 37 |
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
|
|
|
|
| 10 |
---
|
| 11 |
|
| 12 |
# LLM From Scratch
|
| 13 |
+
|
| 14 |
_Ibrahim Khalid_
|
| 15 |
|
| 16 |
+
The hosted project is available on [HuggingFace](https://huggingface.co/spaces/ibrahimmkhalid/llm-from-scratch)
|
| 17 |
|
| 18 |
The purpose of this project is to build a simple large language model from scratch.
|
| 19 |
|
|
|
|
| 20 |
This repo is following the guide from https://www.youtube.com/watch?v=UU1WVnMk4E8
|
| 21 |
|
| 22 |
In this repo:
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
|
| 24 |
+
- ./shakespeare.txt - This is a sample text used for training a smaller scale model
|
| 25 |
+
- ./bigram/bigram_testing.sync.ipynb - This notebook is where I test a basic BiGram model
|
| 26 |
+
- ./bigram/bigram_testing.sync.py - Python script for BiGram testing
|
| 27 |
+
- ./simple_gpt/gpt_shakespeare.sync.ipynb - Notebook implementing simple GPT model using entire works of shakespeare
|
| 28 |
+
- ./simple_gpt/gpt_shakespeare.sync.py - Python script for GPT shakespeare model
|
| 29 |
|
| 30 |
### Prepare environment
|
| 31 |
+
|
| 32 |
```
|
| 33 |
+
pip install -r ./pre-requirements.txt
|
| 34 |
+
pip install -r ./requirements.txt
|
| 35 |
```
|
| 36 |
+
|
| 37 |
---
|
| 38 |
+
|
| 39 |
+
[On GitHub](https://github.com/ibrahimmkhalid/llm-from-scratch)
|
| 40 |
|
| 41 |
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
|