RoPE++
updated
Beyond Real: Imaginary Extension of Rotary Position Embeddings for Long-Context LLMs
Paper
•
2512.07525
•
Published
•
59
SII-xrliu/RoPE-DCLM-376M-4k
0.4B
•
Updated
SII-xrliu/RoPEPP_EH-DCLM-376M-4k
0.4B
•
Updated
•
4
SII-xrliu/RoPEPP_EC-DCLM-376M-4k
0.4B
•
Updated
SII-xrliu/RoPE-DCLM-376M-32k
0.4B
•
Updated
SII-xrliu/RoPEPP_EH-DCLM-376M-32k
0.4B
•
Updated
•
1
SII-xrliu/RoPEPP_EC-DCLM-376M-32k
0.4B
•
Updated
•
16
SII-xrliu/RoPE-DCLM-776M-4k
0.8B
•
Updated
SII-xrliu/RoPEPP_EH-DCLM-776M-4k
0.7B
•
Updated
SII-xrliu/RoPEPP_EC-DCLM-776M-4k
0.8B
•
Updated
SII-xrliu/RoPE-DCLM-776M-32k
0.8B
•
Updated
SII-xrliu/RoPEPP_EH-DCLM-776M-32k
0.7B
•
Updated
SII-xrliu/RoPEPP_EC-DCLM-776M-32k
0.8B
•
Updated
SII-xrliu/RoPE-DCLM-1_5B-4k
SII-xrliu/RoPEPP_EH-DCLM-1_5B-4k
SII-xrliu/RoPEPP_EC-DCLM-1_5B-4k
1B
•
Updated
•
1
SII-xrliu/RoPE-DCLM-1_5B-32k
SII-xrliu/RoPEPP_EH-DCLM-1_5B-32k
SII-xrliu/RoPEPP_EC-DCLM-1_5B-32k