File size: 1,761 Bytes
b57f85a | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 | ---
license: apache-2.0
library_name: transformers
tags:
- gpt2
- solana
- clawd
- code
- text-generation
language:
- en
pipeline_tag: text-generation
---
# deepsol-clawd-code
Merged GPT-2 checkpoint from the Solana Clawd AI training stack (`deepsol-clawd-code-merged`).
## Model details
| | |
|---|---|
| Architecture | `GPT2LMHeadModel` |
| Layers | 12 |
| Hidden size | 768 |
| Heads | 12 |
| Context | 1024 |
| Vocab | 50257 (GPT-2 tokenizer) |
| Weights dtype | float16 (`model.safetensors`) |
| Size | ~237 MB |
## Files
- `model.safetensors` — merged weights
- `config.json` / `generation_config.json`
- `tokenizer.json` / `tokenizer_config.json`
## Quick start
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
repo = "ordlibrary/deepsol-clawd-code"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(repo)
prompt = "def transfer_sol("
inputs = tok(prompt, return_tensors="pt")
out = model.generate(**inputs, max_new_tokens=64)
print(tok.decode(out[0], skip_special_tokens=True))
```
## Intended use
Research / experimentation around Solana-oriented code and tooling assistants in the Clawd training pipeline. This is a small GPT-2-scale model, not a production 7B+ coder.
## Limitations
- Small capacity vs modern LLMs; expect weak long-context and complex reasoning.
- Training data and merge recipe are project-internal; evaluate before any production use.
- Do not rely on it for financial advice or unsigned transaction construction without human review.
## Citation
```bibtex
@misc{deepsol-clawd-code,
title = {deepsol-clawd-code},
author = {ordlibrary},
year = {2026},
howpublished = {\url{https://huggingface.co/ordlibrary/deepsol-clawd-code}}
}
```
|