File size: 2,622 Bytes
fc397cb 17012e4 fc397cb 17012e4 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 | ---
license: mit
datasets:
- Bifrost-AI/Solana-Vanguard-Challenge
language:
- en
metrics:
- accuracy
- code_eval
base_model:
- Bifrost-AI/NextCoder-Mirage-sol-7B
pipeline_tag: text-generation
tags:
- code
- finance
- chat
- text-generation
- large-language-model
library_name: transformers
---
# NextCoder Mirage SOL 7B
### This fine-tuned variant of the NextCoder 7B model was supervised fine-tuned on blockchain-specific datasets(Bifrost-AI/Solana-Vanguard-Challenge), optimized for downstream tasks in blockchain coding and smart contract development on the Solana ecosystem.
The **Solana Vanguard Challenge** dataset, comprising 1,000 diverse and in-depth questions, offers full-spectrum coverage of the Solana ecosystem. It spans fundamental blockchain concepts, advanced on-chain programming in Rust and the Anchor framework, client-side integration in TypeScript, detailed security strategies, and performance as well as regulatory considerations.
NextCoder Mirage SOL 7B is in active development with additional fine-tuning sessions, & benchmark statistics coming soon!
## Provided Quants
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/Bifrost-AI/NextCoder-Mirage-sol-7B-GGUF/resolve/main/nextcoder-Mirage-7.6B-Q4_K_S.gguf) | Q4_K_S | 2.3 | fast, recommended |
| [GGUF](https://huggingface.co/Bifrost-AI/NextCoder-Mirage-sol-7B-GGUF/resolve/main/nextcoder-Mirage-7.6B-Q5_K_S.gguf) | Q5_K_S | 2.8 | fast, recommended |
| [GGUF](https://huggingface.co/Bifrost-AI/NextCoder-Mirage-sol-7B-GGUF/resolve/main/nextcoder-Mirage-7.6B-Q6_K.gguf) | Q6_K | 3.1 | very good quality |
| [GGUF](https://huggingface.co/Bifrost-AI/NextCoder-Mirage-sol-7B-GGUF/resolve/main/nextcoder-Mirage-7.6B-Q8_0.gguf) | Q8_0 | 4.0 | fast, best quality |
| [GGUF](https://huggingface.co/Bifrost-AI/NextCoder-Mirage-sol-7B-GGUF/resolve/main/nextcoder-Mirage-7.6B-F16.gguf) | F16 | 7.7 | 16 bpw, highest quality |
## Training Session:
- Time: 9 hours & 56 minutes
- GPU: NVIDIA GeForce RTX 3090
- Batches: 500
- Context-Size: 2043
- Batch-size: 1
- Learning-rate: 2e-5
- Training-loss: 1.09
- Eval-loss: 0.89
## Dataset Composition
- **Total Questions:** 1,000
- **Languages Covered:**
- **Rust:** On-chain smart contract development, security best practices, advanced state management, CPIs, PDAs, and more.
- **TypeScript:** Client-side integration using @solana/web3.js, wallet adapters, Metaplex for NFT protocols, dynamic transaction composition, and front-end dApp development.
- **Planned Extensions:**
- **C# (Solnet):** To be integrated later for .NET ecosystem coverage. |