BEncoderRT commited on
Commit
76a2e30
·
verified ·
1 Parent(s): eb03849

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -1
README.md CHANGED
@@ -1,3 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  # QLoRA Instruction Tuning on Pythia-1B
2
 
3
  This repository provides a **Hugging Face–compatible LoRA adapter** trained via **QLoRA (4-bit quantization + LoRA adapters)** on the **EleutherAI Pythia-1B-deduped** base model.
@@ -444,4 +458,4 @@ This adapter is intended for **research, experimentation, and non-production use
444
 
445
  ---
446
 
447
- This repository provides a **clean, minimal reference implementation** of QLoRA-based instruction tuning on a 1B-scale language model.
 
1
+ ---
2
+ license: mit
3
+ datasets:
4
+ - databricks/databricks-dolly-15k
5
+ language:
6
+ - en
7
+ base_model:
8
+ - EleutherAI/pythia-1b-deduped
9
+ pipeline_tag: text-generation
10
+ tags:
11
+ - QLORA
12
+ - Instruction-Tuning
13
+ - peft
14
+ ---
15
  # QLoRA Instruction Tuning on Pythia-1B
16
 
17
  This repository provides a **Hugging Face–compatible LoRA adapter** trained via **QLoRA (4-bit quantization + LoRA adapters)** on the **EleutherAI Pythia-1B-deduped** base model.
 
458
 
459
  ---
460
 
461
+ This repository provides a **clean, minimal reference implementation** of QLoRA-based instruction tuning on a 1B-scale language model.