Zoe Noctilucens

Noctilucens's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted a collection almost 2 years ago

OpenChat-3.5-0106 with Additional Layers

Collection

Upscaled models using the Block Expansion method. Unlike the more common DUP Scaling, BE doesn't require fine-tuning to recover lost performance. • 7 items • Updated 26 days ago • 2

upvoted an article almost 2 years ago

view article

Article

Rank-Stabilized LoRA: Unlocking the Potential of LoRA Fine-Tuning

• 

damjan-k

•

Feb 20, 2024

• 33

upvoted 2 papers almost 2 years ago

PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training

Paper • 2309.10400 • Published Sep 19, 2023 • 26

YaRN: Efficient Context Window Extension of Large Language Models

Paper • 2309.00071 • Published Aug 31, 2023 • 85