Commit History
Create phi3-ft-fsdp.yml (#1580) a82a711 unverified
Phi-3 conversation format, example training script and perplexity metric (#1582) cf64284 unverified
fix lint issue that snuck through (#1665) f5febc7 unverified
Fix Lora config error for Llama3 (#1659) 230e0ac unverified
Generalizing the chat_template prompt strategy (#1660) [skip ci] cc11c6b unverified
Keith Stevens commited on
Fix Google Colab notebook 2024-05 (#1662) [skip ci] 5f91064 unverified
Maciek commited on
Update tiny-llama qlora.yml addressing eval packing error (#1638) 84bb806 unverified
Jaydeep Thik commited on
update outputs path so that we can mount workspace to /workspace/data (#1623) 4fde300 unverified
Add ORPO example and e2e test (#1572) 98c25e1 unverified
fix(yml): update llama-3 config (#1543) [skip ci] 0e8f340 unverified
fix broken linting (#1541) c10563c unverified
Adding Llama-3 qlora (#1536) 37c037c unverified
llama-3 examples (#1537) 15f7910 unverified
Create mixtral_22.yml (#1514) [skip ci] 0eadfc8 unverified
Atlas commited on
DBRX Model Support (#1462) 132eb74 unverified
Fix the wrong adapter in qwen2-moe-qlora example (#1501) [skip ci] 7f17eff unverified
qwen2_moe support w multipack (#1455) 6086be8 unverified
fix some of the edge cases for Jamba (#1452) 05b398a unverified
Jamba (#1451) 02af082 unverified
turn sample_packing on for training (#1438) [skip ci] c19d060 unverified
chore(config): refactor old mistral config (#1435) f1ebaa0 unverified
strip out hacky qlora-fsdp workarounds now that qlora-fsdp fixes are upstreamed (#1428) 2a1589f unverified
Fix Gemma 7b qlora.yml (#1405) 6366b0c unverified
Train parameters exclusively in specific ranges (#1390) 05bcc9e unverified
FDSP + QLoRA (#1378) 9b6ee83 unverified
Update tinyllama lora.yml to fix eval packing issue (#1362) 8984bf1 unverified
chore: enable sample_packing for Gemma (#1351) 170d4d7 unverified
Add StableLM 2 Example Scripts (#1327) [skip ci] f30d062 unverified
multipack for gemma (#1313) 2752d5f unverified
Adding Google's gemma Model (#1312) 9e300ac unverified
Add instructions for playing with qlora model to colab example (#1290) 6ab69ec unverified
fix(examples): remove is_*_derived as it's parsed automatically (#1297) a7a9a14 unverified
Add seq2seq eval benchmark callback (#1274) 5a5d474 unverified
Add MPS support (#1264) fac2d98 unverified
lock pytorch (#1247) [skip ci] 1c7ed26 unverified
JohanWork commited on
Pretrain transforms (#1261) c7cf381 unverified
Peft lotfq (#1222) 4cb7900 unverified
Update qlora.yml - remove `max_packed_sequence_len` (#1210) [skip ci] 5407ddd unverified
add colab example (#1196) [skip ci] ee0b5f6 unverified
JohanWork commited on
