Molten-Ice commited on
Commit
6a4bfdc
·
1 Parent(s): 6b1db4d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -20
README.md CHANGED
@@ -11,23 +11,15 @@ Edit this `README.md` markdown file to author your organization card 🔥
11
 
12
  *Chatgpt generated summary*
13
 
14
- Workflow Steps
15
- Database Generation
16
-
17
- A space named 'database-generation' accepts a .jsonl file of inputs and produces a file of the ChatGPT generations.
18
- This output is stored in a separate Hugging Face 'dataset' repo, circumventing spaces' lack of persistent memory.
19
- A user interface opens at the end for review of generations.
20
- This space runs on a CPU and thus is free.
21
- Model Training
22
-
23
- In this space, you select the dataset for training which it fetches from the HF 'dataset' repo.
24
- Post-training, it stores the new fine-tuned model in a HF 'models' repo.
25
- Another user interface opens for reviewing the fine-tuned generations.
26
- The space has a 15-minute idle timeout.
27
- Model Inference
28
-
29
- You select the fine-tuned model for use in the readme of this space.
30
- If no model is specified, it uses the base (non-fine-tuned) model.
31
- Important Notes
32
- Any change, even to the readme, triggers a full restart of the space.
33
- The script, upon completion, will re-run in a continuous cycle.
 
11
 
12
  *Chatgpt generated summary*
13
 
14
+ Workflow Summary
15
+
16
+ Database Generation:
17
+
18
+ - jsonl file (inputs) -> ChatGPT generations -> HF 'dataset' repo
19
+ Model Training:
20
+
21
+ - Selected dataset from HF 'dataset' repo -> Fine-tuned model -> HF 'models' repo
22
+
23
+ Model Inference:
24
+
25
+ - Selected fine-tuned model (or base model if none selected) -> Inference results