Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up
AmareshHebbar 's Collections
Ternary1B
ShortThink
Stretch32K
ToolSure
Abliterated Weights 2.0
Abliteration Weights( i made a better version above)
LeetCode Multi-Language Coder Suite
LeetCode Code-Gen Datasets
Astrology & Divination SFT Datasets
Medical AI Fine-tuned Model Suite
AxisMapper Medical AI Suite

Stretch32K

updated 4 days ago

TinyLlama 1.1B stretched from 2k to long context on one GPU. PI, NTK, YaRN, LongLoRA and SFT on one table.

Upvote
-

  • AmareshHebbar/Stretch32K_Data_TinyLlama_1.1B

    Viewer • Updated 4 days ago • 1.23k • 80

    Note Training data shared by every model in this collection


  • AmareshHebbar/Stretch32K_TinyLlama_1.1B_PI

    Text Generation • 1B • Updated 4 days ago • 115

    Note Stretch32K PI


  • AmareshHebbar/Stretch32K_TinyLlama_1.1B_YARN

    Text Generation • 1B • Updated 4 days ago • 107

    Note Stretch32K YARN


  • AmareshHebbar/Stretch32K_TinyLlama_1.1B_YARN_LONGLORA

    Text Generation • 1B • Updated 4 days ago • 94

    Note Stretch32K YARN_LONGLORA


  • AmareshHebbar/Stretch32K_TinyLlama_1.1B_SFT

    Text Generation • 1B • Updated 4 days ago • 102

    Note Stretch32K SFT

Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs