|
|
--- |
|
|
thumbnail: "https://cdn-uploads.huggingface.co/production/uploads/66c26b6fb01b19d8c3c2467b/jg2NWmCUfPyzizm2USjMt.jpeg" |
|
|
datasets: |
|
|
- Mielikki/Erebus-87k |
|
|
- NewEden/Orion-Asstr-Stories-16K |
|
|
- NewEden/Orion-LIT |
|
|
- NewEden/Fujin-Cleaned-Final |
|
|
|
|
|
base_model: |
|
|
- IntervitensInc/Llama-3.1-Minitron-4B-Width-Base-chatml |
|
|
tags: |
|
|
- llama |
|
|
- roleplay |
|
|
- finetune |
|
|
- storywriting |
|
|
--- |
|
|
<!DOCTYPE html> |
|
|
<style> |
|
|
html, body { |
|
|
background: black; |
|
|
color: #c9d1d9 !important; |
|
|
font-family: 'Segoe UI', Tahoma, Geneva, Verdana, sans-serif; |
|
|
margin: 0; |
|
|
padding: 0; |
|
|
min-height: 100vh; |
|
|
} |
|
|
.markdown-body { |
|
|
color: white; |
|
|
margin: 40px auto; |
|
|
padding: 40px; |
|
|
border-radius: 12px; |
|
|
position: relative; |
|
|
overflow: hidden; |
|
|
} |
|
|
|
|
|
.markdown-body::after { |
|
|
content: ''; |
|
|
position: absolute; |
|
|
top: 0; |
|
|
left: 0; |
|
|
width: 100%; |
|
|
height: 100%; |
|
|
background: #0c0f18; /* background color */ |
|
|
pointer-events: none; |
|
|
z-index: -999; |
|
|
} |
|
|
|
|
|
h1, h2, h3 { |
|
|
background: linear-gradient(45deg, #6e00ff, #00ffff); |
|
|
-webkit-background-clip: text; |
|
|
-webkit-text-fill-color: transparent; |
|
|
border-bottom: 1px solid #333; |
|
|
padding-bottom: 0.3em; |
|
|
} |
|
|
|
|
|
div[style*="border:2px solid #333"], |
|
|
div[style*="border: 2px solid #333"], |
|
|
div[style*="border:1px solid #333"], |
|
|
div[style*="border: 1px solid #333"] { |
|
|
background: rgba(22, 27, 34, 0.8) !important; |
|
|
border: 2px solid #6e00ff !important; |
|
|
box-shadow: 0 0 15px rgba(110, 0, 255, 0.5); |
|
|
border-radius: 10px; |
|
|
padding: 20px; |
|
|
margin: 20px 0; |
|
|
} |
|
|
|
|
|
code { |
|
|
background-color: #1a1a1a !important; |
|
|
border-radius: 4px; |
|
|
padding: 0.2em 0.4em; |
|
|
color: #00ffff; |
|
|
} |
|
|
|
|
|
pre { |
|
|
background-color: #1a1a1a !important; |
|
|
border: 1px solid #333; |
|
|
border-radius: 8px; |
|
|
padding: 16px; |
|
|
} |
|
|
|
|
|
table { |
|
|
width: 100%; |
|
|
border-collapse: collapse; |
|
|
margin: 20px 0; |
|
|
background: rgba(0,0,0,0.2); |
|
|
table-layout: fixed; |
|
|
color: white; |
|
|
} |
|
|
|
|
|
th, td { |
|
|
border: 1px solid #333; |
|
|
padding: 12px; |
|
|
text-align: center; |
|
|
color: white; |
|
|
} |
|
|
|
|
|
th { |
|
|
background: rgba(110, 0, 255, 0.1); |
|
|
} |
|
|
|
|
|
td:nth-child(1) { |
|
|
width: 1%; |
|
|
white-space: nowrap; |
|
|
} |
|
|
|
|
|
td:nth-child(2) { |
|
|
width: 100%; |
|
|
} |
|
|
|
|
|
td > span { |
|
|
display: block; |
|
|
padding: 4px 8px; |
|
|
background: rgba(110, 0, 255, 0.1); |
|
|
border-radius: 4px; |
|
|
transition: all 0.3s ease; |
|
|
} |
|
|
|
|
|
td > span:hover { |
|
|
background: rgba(110, 0, 255, 0.2); |
|
|
transform: translateY(-1px); |
|
|
} |
|
|
|
|
|
a { |
|
|
color: #00ffff; |
|
|
text-decoration: none; |
|
|
transition: all 0.3s ease; |
|
|
} |
|
|
|
|
|
a:hover { |
|
|
color: #6e00ff; |
|
|
text-decoration: none; |
|
|
} |
|
|
|
|
|
hr { |
|
|
border: 0; |
|
|
height: 1px; |
|
|
background: linear-gradient(90deg, transparent, #333, transparent); |
|
|
margin: 40px 0; |
|
|
} |
|
|
|
|
|
img { |
|
|
max-width: 100%; |
|
|
border-radius: 10px; |
|
|
} |
|
|
|
|
|
details summary:hover { |
|
|
color: #00ffff; |
|
|
} |
|
|
|
|
|
* { |
|
|
color-scheme: dark !important; |
|
|
} |
|
|
|
|
|
.prose, .max-w-none, .px-4 { |
|
|
background-color: transparent !important; |
|
|
color: #c9d1d9 !important; |
|
|
} |
|
|
</style> |
|
|
<body> |
|
|
<div class="markdown-body"> |
|
|
<div align="center"> |
|
|
|
|
|
<img src="https://cdn-uploads.huggingface.co/production/uploads/66c26b6fb01b19d8c3c2467b/o5WjJKA9f95ri9UzRxZQE.png" alt="Model Visualization" width="500px" style="border: 3px solid #333; box-shadow: 0 0 15px rgba(66, 0, 131, 0.5);" /> |
|
|
|
|
|
<br> |
|
|
<br> |
|
|
|
|
|
<div style="font-size:1.5em; font-weight:bold; background: linear-gradient(45deg, #6e00ff, #00ffff); -webkit-background-clip: text; -webkit-text-fill-color: transparent;"> |
|
|
Hamanasu 4B |
|
|
</div> |
|
|
|
|
|
</div> |
|
|
|
|
|
<div style="border:1px solid #333; border-radius:10px; padding:20px; margin:20px 0; background: rgba(0,0,0,0.4);"> |
|
|
|
|
|
|
|
|
## 🌌 Overview |
|
|
|
|
|
<i>This model is a finetune of Llama-3.1-Minitron-4B-Width-Base-chatml on 1B tokens of Stories & Books </i> |
|
|
|
|
|
<i>This model is not usable for Chat.</i> |
|
|
|
|
|
<i>All thanks to Tav for funding the train.</i> |
|
|
|
|
|
</div> |
|
|
|
|
|
<div style="display: grid; grid-template-columns: repeat(auto-fit, minmax(250px, 1fr)); gap: 20px; margin: 20px 0;"> |
|
|
|
|
|
|
|
|
<div style="border:2px solid #333; border-radius:10px; padding:20px; background: rgba(0,0,0,0.2);"> |
|
|
|
|
|
### ⚔️ Hardware |
|
|
- 8x H100s |
|
|
- Epochs: 1 |
|
|
- Base: `IntervitensInc/Llama-3.1-Minitron-4B-Width-Base-chatml` |
|
|
</div> |
|
|
|
|
|
</div> |
|
|
|
|
|
|
|
|
<div style="border: 2px solid #6e00ff; border-radius: 10px; padding: 20px; margin: 20px 0; box-shadow: 0 0 15px rgba(110, 0, 255, 0.5);"> |
|
|
|
|
|
## Axolotl Config ꒰(˶• ᴗ •˶)꒱ |
|
|
|
|
|
<details> |
|
|
|
|
|
```yaml |
|
|
https://wandb.ai/new-eden/tavbussy/artifacts/axolotl-config/config-jpgzpr2g/v0/files/axolotl_config_3y5zkvbz.yml |
|
|
``` |
|
|
|
|
|
</details> |
|
|
</div> |
|
|
|
|
|
<div align="center"> |
|
|
|
|
|
<div style="border: 2px solid #6e00ff; border-radius: 10px; padding: 20px; margin: 20px 0; box-shadow: 0 0 15px rgba(110, 0, 255, 0.5);"> |
|
|
|
|
|
## ⚡ Credits |
|
|
<div style="display: flex; justify-content: center;"> |
|
|
<div style="display: grid; grid-template-columns: repeat(auto-fit, minmax(200px, 1fr)); gap: 10px; margin: 20px 0; max-width: 600px;"> |
|
|
|
|
|
<div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;"> |
|
|
<a href="https://huggingface.co/lucyknada"> |
|
|
<img src="https://img.shields.io/badge/%F0%9F%8C%9F-Lucy_Knada-blueviolet" alt="Lucy Knada"> |
|
|
</a> |
|
|
</div> |
|
|
|
|
|
<div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;"> |
|
|
<a href="https://huggingface.co/hamanasu"> |
|
|
<img src="https://img.shields.io/badge/%E2%9A%94%EF%B8%8F-jeiku-blueviolet" alt="Ruka"> |
|
|
</a> |
|
|
</div> |
|
|
|
|
|
<div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;"> |
|
|
<a href="https://huggingface.co/intervitens"> |
|
|
<img src="https://img.shields.io/badge/%F0%9F%9B%A1%EF%B8%8F-Intervitens-blueviolet" alt="Intervitens"> |
|
|
</a> |
|
|
</div> |
|
|
|
|
|
<div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;"> |
|
|
<a href="https://huggingface.co/kalomaze"> |
|
|
<img src="https://img.shields.io/badge/%F0%9F%94%AE-Kalomaze-blueviolet" alt="Kalomaze"> |
|
|
</a> |
|
|
</div> |
|
|
|
|
|
<div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;"> |
|
|
<a href="https://huggingface.co/kubernetes-bad"> |
|
|
<img src="https://img.shields.io/badge/%E2%9A%A1-Kubernetes_Bad-blueviolet" alt="Kubernetes Bad"> |
|
|
</a> |
|
|
</div> |
|
|
|
|
|
<div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;"> |
|
|
<a href="https://huggingface.co/anthracite-org"> |
|
|
<img src="https://img.shields.io/badge/%F0%9F%8C%91-Anthracite-blueviolet" alt="Anthracite"> |
|
|
</a> |
|
|
</div> |
|
|
</div> |
|
|
</div> |
|
|
</div> |
|
|
|
|
|
--- |
|
|
|
|
|
<div align="center"> |
|
|
<div style="font-size:0.8em; opacity:0.8;">Made by</div> |
|
|
<div style="font-size:1.2em; font-weight:bold; background: linear-gradient(45deg, #6e00ff, #00ffff); -webkit-background-clip: text; -webkit-text-fill-color: transparent;">Delta-Vector</div> |
|
|
</div> |
|
|
|
|
|
</div> |
|
|
</body> |
|
|
</html> |
|
|
|
