Spaces:
Sleeping
Sleeping
SpinalCord LLM: training, dashboard, speculative decoding, deploy docs, early-exit brain (PyTorch)
f52586c | @echo off | |
| REM βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | |
| REM SpinalCord LLM β Environment Setup Script | |
| REM AppDice | Shivansh Darji | |
| REM Run this ONCE to set up your development environment. | |
| REM βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | |
| echo. | |
| echo βββββββββββββββββββββββββββββββββββββββββββββββββ | |
| echo β SpinalCord LLM β Setup Script β | |
| echo β AppDice ^| Shivansh Darji β | |
| echo βββββββββββββββββββββββββββββββββββββββββββββββββ | |
| echo. | |
| REM βββ STEP 1: Check Python ββββββββββββββββββββββββββββββββββββββββββ | |
| echo [1/5] Checking Python... | |
| python --version >nul 2>&1 | |
| if errorlevel 1 ( | |
| echo β Python not found! | |
| echo Download from: https://www.python.org/downloads/ | |
| pause | |
| exit /b 1 | |
| ) | |
| python --version | |
| echo β Python found | |
| REM βββ STEP 2: Install PyTorch with CUDA 11.8 βββββββββββββββββββββββ | |
| echo. | |
| echo [2/5] Installing PyTorch with CUDA 11.8 support (RTX 2050)... | |
| echo This may take a few minutes... | |
| pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118 --quiet | |
| if errorlevel 1 ( | |
| echo β PyTorch installation failed | |
| pause | |
| exit /b 1 | |
| ) | |
| echo β PyTorch installed | |
| REM βββ STEP 3: Install other requirements βββββββββββββββββββββββββββ | |
| echo. | |
| echo [3/5] Installing remaining dependencies... | |
| pip install transformers datasets accelerate safetensors tqdm numpy matplotlib rich --quiet | |
| if errorlevel 1 ( | |
| echo β οΈ Some packages may have failed. Check output above. | |
| ) else ( | |
| echo β Dependencies installed | |
| ) | |
| REM βββ STEP 4: Clone llama.cpp ββββββββββββββββββββββββββββββββββββββ | |
| echo. | |
| echo [4/5] Cloning llama.cpp... | |
| if exist "..\llama.cpp" ( | |
| echo β llama.cpp already cloned at ..\llama.cpp | |
| ) else ( | |
| git clone https://github.com/ggml-org/llama.cpp ..\llama.cpp | |
| if errorlevel 1 ( | |
| echo β Git clone failed. Make sure Git is installed. | |
| echo Download: https://git-scm.com/download/win | |
| ) else ( | |
| echo β llama.cpp cloned to ..\llama.cpp | |
| ) | |
| ) | |
| REM βββ STEP 5: Verify GPU βββββββββββββββββββββββββββββββββββββββββββ | |
| echo. | |
| echo [5/5] Checking GPU/CUDA availability... | |
| python -c "import torch; print('CUDA available:', torch.cuda.is_available()); print('GPU:', torch.cuda.get_device_name(0) if torch.cuda.is_available() else 'None')" | |
| echo. | |
| echo βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | |
| echo β¨ Setup complete! | |
| echo. | |
| echo NEXT STEPS: | |
| echo 1. Open dashboard\index.html in your browser to see the UI | |
| echo 2. cd train ^&^& python train.py (to train the model) | |
| echo 3. Build llama.cpp with CUDA (see README.md for instructions) | |
| echo βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | |
| echo. | |
| pause | |