{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# SmartCore V1 - Faz 2 Colab Smoke (GPU)\n",
    "\n",
    "Pre-tokenize veriden (kdirgul/smartcore-v1-data) streaming + model + WSD loop, A100.\n",
    "Onkosul: Colab Pro+/A100. NOT: smoke saf-PyTorch minimal (yavas); tam-hiz Faz 3 = mamba-og fork (Triton)."
   ]
  },
  {
   "cell_type": "code",
   "metadata": {},
   "execution_count": null,
   "outputs": [],
   "source": [
    "!nvidia-smi -L\n",
    "!pip -q install -U einops sentencepiece \"datasets>=2.18\" \"huggingface_hub>=0.23\" pyarrow"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 1) HF login"
   ]
  },
  {
   "cell_type": "code",
   "metadata": {},
   "execution_count": null,
   "outputs": [],
   "source": [
    "from huggingface_hub import login, get_token\n",
    "login()  # acilan kutuya token'i yapistir\n",
    "assert get_token(), 'Token yok - once login hucresini calistir.'"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 2) Kodu HF'den indir"
   ]
  },
  {
   "cell_type": "code",
   "metadata": {},
   "execution_count": null,
   "outputs": [],
   "source": [
    "import os, sys\n",
    "from huggingface_hub import snapshot_download, get_token\n",
    "tok = get_token()\n",
    "assert tok, 'HF token yok (login).'\n",
    "os.environ['HF_TOKEN'] = tok\n",
    "p = snapshot_download('kdirgul/smartcore-v1', allow_patterns=['code/**'], repo_type='model', token=tok)\n",
    "CODE = os.path.join(p, 'code')\n",
    "print('kod dizini:', CODE)\n",
    "print('kod/:', os.listdir(os.path.join(CODE, 'kod'))[:6])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 3) Smoke (canli cikti)"
   ]
  },
  {
   "cell_type": "code",
   "metadata": {},
   "execution_count": null,
   "outputs": [],
   "source": [
    "import os, sys\n",
    "os.chdir(CODE)\n",
    "!{sys.executable} -u kod/faz2_train_shards.py --data kdirgul/smartcore-v1-data --hf --d_model 512 --n_layer 12 --seq_len 1024 --micro_batch 8 --steps 40 --device cuda"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Basari kriterleri\n",
    "- loss ~10.8'den dusuyor, NaN yok, exit 0. (Dogrulandi: loss 10.875->9.428.)\n",
    "\n",
    "## Siradaki: Faz 3 (fork/Triton + tam config + checkpoint/resume). Bkz. sohbet 3a-3d plani."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "name": "python3"
  },
  "language_info": {
   "name": "python"
  },
  "accelerator": "GPU",
  "colab": {
   "provenance": []
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}