StartLux

company

https://x.com/StartLuxAI

AI & ML interests

None defined yet.

Recent Activity

Lie24 updated a model 1 day ago

startlux-models/StartLux-Decision-27B-BF16-GGUF

Lie24 updated a model 1 day ago

startlux-models/StartLux-Decision-27B-Q4_K_M-GGUF

Lie24 updated a model 1 day ago

startlux-models/StartLux-Decision-27B-Q8_0-GGUF

View all activity

Papers

Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus

View all Papers

startlux-models 's models 31

startlux-models/StartLux-Decision-27B

28B • Updated about 21 hours ago • 1 • 1

startlux-models/StartLux-Decision-4B-Q4_K_M-GGUF

4B • Updated about 21 hours ago • 25

startlux-models/StartLux-Decision-9B

10B • Updated about 21 hours ago • 1

startlux-models/StartLux-Decision-4B-Q8_0-GGUF

4B • Updated about 21 hours ago • 24

startlux-models/StartLux-Decision-0.8B-Q4_K_M-GGUF

0.8B • Updated about 21 hours ago • 30

startlux-models/StartLux-Decision-4B

5B • Updated about 21 hours ago • 2

startlux-models/StartLux-Decision-4B-BF16-GGUF

4B • Updated about 21 hours ago • 24

startlux-models/StartLux-Decision-0.8B-Q8_0-GGUF

0.8B • Updated about 21 hours ago • 29

startlux-models/StartLux-Decision-0.8B-BF16-GGUF

0.8B • Updated about 21 hours ago • 21

startlux-models/StartLux-Decision-27B-Q4_K_M-GGUF

27B • Updated about 21 hours ago • 22

startlux-models/StartLux-Decision-2B

2B • Updated about 21 hours ago • 2 • 1

startlux-models/StartLux-Decision-9B-Q4_K_M-GGUF

9B • Updated about 21 hours ago • 24

startlux-models/StartLux-Decision-2B-Q4_K_M-GGUF

2B • Updated about 21 hours ago • 22

startlux-models/StartLux-Decision-27B-Q8_0-GGUF

27B • Updated about 21 hours ago • 23

startlux-models/StartLux-Decision-0.8B

0.9B • Updated about 21 hours ago • 1 • 1

startlux-models/StartLux-Decision-2B-Q8_0-GGUF

2B • Updated about 21 hours ago • 21

startlux-models/StartLux-Decision-9B-Q8_0-GGUF

9B • Updated about 21 hours ago • 23

startlux-models/StartLux-Decision-27B-BF16-GGUF

27B • Updated about 21 hours ago • 23

startlux-models/StartLux-Decision-9B-BF16-GGUF

9B • Updated about 21 hours ago • 20

startlux-models/StartLux-Decision-2B-BF16-GGUF

2B • Updated about 21 hours ago • 22

startlux-models/Massive-Activations-HLA

Text Generation • Updated Aug 13

startlux-models/gdn-1.3b-isp-hybrid-3to1-50b

Text Generation • 1B • Updated Aug 13 • 49

startlux-models/gdn-gatedfa-340m-isp-hybrid-3to1-10b

Text Generation • 0.4B • Updated Aug 13 • 43

startlux-models/gdn-nooutgate-340m-isp-hybrid-3to1-10b

Text Generation • 0.4B • Updated Aug 13 • 42

startlux-models/gdn-340m-isp-hybrid-3to1-10b

Text Generation • 0.4B • Updated Aug 13 • 50

startlux-models/gdn-1.3b-pas-fa-layer12-50b

Text Generation • 1B • Updated Aug 13 • 41

startlux-models/gdn-gatedfa-340m-pas-fa-layer12-10b

Text Generation • 0.4B • Updated Aug 13 • 41

startlux-models/gdn-nooutgate-340m-pas-fa-layer12-10b

Text Generation • 0.4B • Updated Aug 13 • 41

startlux-models/gdn-340m-pas-fa-layer20-10b

Text Generation • 0.4B • Updated Aug 13 • 47

startlux-models/gdn-340m-pas-fa-layer12-10b

Text Generation • 0.4B • Updated Aug 13 • 56