TokenBender/code_instructions_122k_alpaca_style
Viewer • Updated • 122k • 1.86k • 80
How to use sadaisystems/mistral-inst-v0.2-code40k with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("sadaisystems/mistral-inst-v0.2-code40k", dtype="auto")This is a LoRA adapter for Mistral-Instruct-v0.2
Base Model: Mistral-Instruct-v0.2 Dataset: TokenBender/code_instructions_122k_alpaca_style
Test run, trained on subsample of 5k examples for 1 epoch using QLoRa technique.
Final loss: 0.394200
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("sadaisystems/mistral-inst-v0.2-code40k", dtype="auto")