Spaces:
Sleeping
Sleeping
| # π₯οΈ Windows GPU νκ²½ λ°°ν¬ κ°μ΄λ | |
| ## π μ¬μ μꡬμ¬ν | |
| ### 1. νλμ¨μ΄ μꡬμ¬ν | |
| - **GPU**: NVIDIA GPU (RTX 3060 μ΄μ κΆμ₯) | |
| - **λ©λͺ¨λ¦¬**: μ΅μ 16GB RAM, κΆμ₯ 32GB RAM | |
| - **μ μ₯곡κ°**: μ΅μ 50GB μ¬μ κ³΅κ° | |
| ### 2. μννΈμ¨μ΄ μꡬμ¬ν | |
| #### NVIDIA λλΌμ΄λ² μ€μΉ | |
| 1. **NVIDIA μΉμ¬μ΄νΈ λ°©λ¬Έ**: https://www.nvidia.com/Download/index.aspx | |
| 2. **GPU λͺ¨λΈ μ ν**: μ¬μ© μ€μΈ GPU λͺ¨λΈ μ ν | |
| 3. **λλΌμ΄λ² λ€μ΄λ‘λ**: μ΅μ λλΌμ΄λ² λ€μ΄λ‘λ λ° μ€μΉ | |
| 4. **μ¬λΆν **: μ€μΉ μλ£ ν μμ€ν μ¬λΆν | |
| #### Docker Desktop μ€μΉ | |
| 1. **Docker Desktop λ€μ΄λ‘λ**: https://www.docker.com/products/docker-desktop | |
| 2. **μ€μΉ μ€ν**: λ€μ΄λ‘λν νμΌ μ€ν | |
| 3. **WSL 2 μ€μ **: Windows Subsystem for Linux 2 νμ±ν | |
| 4. **μ¬λΆν **: μ€μΉ μλ£ ν μμ€ν μ¬λΆν | |
| #### Python GPU λΌμ΄λΈλ¬λ¦¬ μ€μΉ | |
| ```cmd | |
| # κ°μνκ²½ νμ±ν | |
| lily_llm_env\Scripts\activate | |
| # PyTorch GPU λ²μ μ€μΉ | |
| pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118 | |
| # Hugging Face λΌμ΄λΈλ¬λ¦¬ μ€μΉ | |
| pip install transformers huggingface_hub | |
| # μΆκ° GPU λΌμ΄λΈλ¬λ¦¬ μ€μΉ | |
| pip install accelerate bitsandbytes | |
| ``` | |
| ## π§ νκ²½ μ€μ | |
| ### 1. GPU νκ²½ νμΈ | |
| ```cmd | |
| cd C:\Project\lily_generate_project\lily_generate_package | |
| python check_gpu_environment.py | |
| ``` | |
| ### 2. Windows GPU μ€μ | |
| ```cmd | |
| # Windows GPU νκ²½ μ€μ μ€ν¬λ¦½νΈ μ€ν | |
| windows_gpu_setup.bat | |
| ``` | |
| ### 3. Hugging Face μ€μ | |
| ```cmd | |
| # Hugging Face ν ν° μ€μ | |
| huggingface-cli login | |
| # λλ Python μ€ν¬λ¦½νΈλ‘ μ€μ | |
| python huggingface_gpu_setup.py | |
| ``` | |
| ## π λ°°ν¬ μ€ν | |
| ### 1. μλ λ°°ν¬ (κΆμ₯) | |
| ```cmd | |
| # Windows GPU λ°°ν¬ μ€ν¬λ¦½νΈ μ€ν | |
| deploy_gpu_windows.bat | |
| ``` | |
| ### 2. μλ λ°°ν¬ | |
| ```cmd | |
| # 1. κΈ°μ‘΄ 컨ν μ΄λ μ 리 | |
| docker-compose -f docker-compose.gpu.yml down --volumes --remove-orphans | |
| # 2. μ΄λ―Έμ§ λΉλ | |
| docker-compose -f docker-compose.gpu.yml build --no-cache | |
| # 3. 컨ν μ΄λ μμ | |
| docker-compose -f docker-compose.gpu.yml up -d | |
| # 4. μλΉμ€ μν νμΈ | |
| docker-compose -f docker-compose.gpu.yml logs -f | |
| ``` | |
| ## π§ͺ ν μ€νΈ | |
| ### 1. GPU λ°°ν¬ ν μ€νΈ | |
| ```cmd | |
| python test_gpu_deployment.py | |
| ``` | |
| ### 2. Hugging Face λͺ¨λΈ ν μ€νΈ | |
| ```cmd | |
| python huggingface_gpu_setup.py | |
| ``` | |
| ### 3. API ν μ€νΈ | |
| ```cmd | |
| curl http://localhost:8001/health | |
| ``` | |
| ## π λͺ¨λν°λ§ | |
| ### 1. GPU μ¬μ©λ νμΈ | |
| ```cmd | |
| # GPU μ 보 νμΈ | |
| nvidia-smi | |
| # μ€μκ° λͺ¨λν°λ§ | |
| nvidia-smi -l 1 | |
| ``` | |
| ### 2. 컨ν μ΄λ μν νμΈ | |
| ```cmd | |
| # μ€ν μ€μΈ 컨ν μ΄λ νμΈ | |
| docker ps | |
| # 컨ν μ΄λ 리μμ€ μ¬μ©λ νμΈ | |
| docker stats | |
| ``` | |
| ### 3. λ‘κ·Έ νμΈ | |
| ```cmd | |
| # μ 체 λ‘κ·Έ | |
| docker-compose -f docker-compose.gpu.yml logs -f | |
| # νΉμ μλΉμ€ λ‘κ·Έ | |
| docker-compose -f docker-compose.gpu.yml logs -f lily-llm-api-gpu | |
| ``` | |
| ## π§ λ¬Έμ ν΄κ²° | |
| ### 1. NVIDIA λλΌμ΄λ² λ¬Έμ | |
| ```cmd | |
| # λλΌμ΄λ² λ²μ νμΈ | |
| nvidia-smi | |
| # λ¬Έμ λ°μ μ λλΌμ΄λ² μ¬μ€μΉ | |
| # 1. κΈ°μ‘΄ λλΌμ΄λ² μ κ±° | |
| # 2. μ΅μ λλΌμ΄λ² λ€μ΄λ‘λ λ° μ€μΉ | |
| # 3. μμ€ν μ¬λΆν | |
| ``` | |
| ### 2. Docker λ¬Έμ | |
| ```cmd | |
| # Docker Desktop μ¬μμ | |
| # Docker Desktop > Settings > General > Restart | |
| # WSL 2 νμΈ | |
| wsl --list --verbose | |
| # Docker κΆν λ¬Έμ ν΄κ²° | |
| # Docker Desktop > Settings > Resources > WSL Integration | |
| ``` | |
| ### 3. CUDA λ²μ μΆ©λ | |
| ```cmd | |
| # PyTorch CUDA λ²μ νμΈ | |
| python -c "import torch; print(torch.version.cuda)" | |
| # CUDA λ²μ μ λ§λ PyTorch μ¬μ€μΉ | |
| pip uninstall torch torchvision torchaudio | |
| pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118 | |
| ``` | |
| ### 4. λ©λͺ¨λ¦¬ λΆμ‘± | |
| ```cmd | |
| # GPU λ©λͺ¨λ¦¬ νμΈ | |
| nvidia-smi | |
| # 컨ν μ΄λ μ¬μμ | |
| docker-compose -f docker-compose.gpu.yml restart | |
| # λ©λͺ¨λ¦¬ μ΅μ ν μ μ© | |
| python performance_optimization.py | |
| ``` | |
| ## π μ±λ₯ μ΅μ ν | |
| ### 1. Windows μ μ© μ΅μ ν | |
| ```cmd | |
| # κ°μ λ©λͺ¨λ¦¬ μ¦κ° | |
| # μ μ΄ν > μμ€ν > κ³ κΈ μμ€ν μ€μ > μ±λ₯ > μ€μ > κ³ κΈ > κ°μ λ©λͺ¨λ¦¬ | |
| # μ μ μ€μ μ΅μ ν | |
| # μ μ΄ν > μ μ μ΅μ > κ³ μ±λ₯ μ ν | |
| ``` | |
| ### 2. Docker μ΅μ ν | |
| ```cmd | |
| # Docker Desktop μ€μ μ΅μ ν | |
| # Docker Desktop > Settings > Resources | |
| # - Memory: 8GB μ΄μ ν λΉ | |
| # - CPUs: 4κ° μ΄μ ν λΉ | |
| # - Disk image size: 64GB μ΄μ | |
| ``` | |
| ### 3. GPU λ©λͺ¨λ¦¬ μ΅μ ν | |
| ```python | |
| # 4-bit μμν μ μ© | |
| python huggingface_gpu_setup.py | |
| # λ°°μΉ ν¬κΈ° μ‘°μ | |
| # config.yamlμμ batch_size μ‘°μ | |
| ``` | |
| ## π μ λ°μ΄νΈ | |
| ### 1. λͺ¨λΈ μ λ°μ΄νΈ | |
| ```cmd | |
| # μ΅μ λͺ¨λΈ λ€μ΄λ‘λ | |
| python huggingface_gpu_setup.py | |
| # 컨ν μ΄λ μ¬μμ | |
| docker-compose -f docker-compose.gpu.yml restart | |
| ``` | |
| ### 2. μ½λ μ λ°μ΄νΈ | |
| ```cmd | |
| # μ½λ λ³κ²½ ν μ¬λΉλ | |
| docker-compose -f docker-compose.gpu.yml build --no-cache | |
| docker-compose -f docker-compose.gpu.yml up -d | |
| ``` | |
| ## π μ§μ | |
| ### λ¬Έμ λ°μ μ νμΈμ¬ν | |
| 1. **GPU λλΌμ΄λ²**: `nvidia-smi` λͺ λ Ήμ΄ μ€ν κ°λ₯ μ¬λΆ | |
| 2. **Docker Desktop**: WSL 2 ν΅ν© νμ±ν μ¬λΆ | |
| 3. **CUDA λ²μ **: PyTorchμ CUDA λ²μ νΈνμ± | |
| 4. **μμ€ν λ©λͺ¨λ¦¬**: 16GB μ΄μ μ¬μ λ©λͺ¨λ¦¬ | |
| 5. **GPU λ©λͺ¨λ¦¬**: 8GB μ΄μ GPU λ©λͺ¨λ¦¬ | |
| ### λ‘κ·Έ νμΌ μμΉ | |
| - **Docker λ‘κ·Έ**: `docker-compose -f docker-compose.gpu.yml logs` | |
| - **μ ν리μΌμ΄μ λ‘κ·Έ**: `logs/` λλ ν 리 | |
| - **GPU λ‘κ·Έ**: `nvidia-smi` | |
| ## π― Windows μ μ© ν | |
| ### 1. WSL 2 μ΅μ ν | |
| ```cmd | |
| # WSL 2 λ©λͺ¨λ¦¬ μ ν μ€μ | |
| # %UserProfile%\.wslconfig νμΌ μμ± | |
| [wsl2] | |
| memory=8GB | |
| processors=4 | |
| ``` | |
| ### 2. Windows Defender μμΈ μ€μ | |
| ```cmd | |
| # νλ‘μ νΈ ν΄λλ₯Ό Windows Defender μμΈμ μΆκ° | |
| # Windows 보μ > λ°μ΄λ¬μ€ λ° μν λ°©μ§ > μ€μ > μμΈ μΆκ° | |
| ``` | |
| ### 3. μ μ κ΄λ¦¬ μ΅μ ν | |
| ```cmd | |
| # κ³ μ±λ₯ μ μ κ³ν μ ν | |
| powercfg /setactive 8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c | |
| ``` | |
| ## π λΉ λ₯Έ μμ | |
| ### 1λ¨κ³: νκ²½ νμΈ | |
| ```cmd | |
| windows_gpu_setup.bat | |
| ``` | |
| ### 2λ¨κ³: Hugging Face μ€μ | |
| ```cmd | |
| python huggingface_gpu_setup.py | |
| ``` | |
| ### 3λ¨κ³: GPU λ°°ν¬ | |
| ```cmd | |
| deploy_gpu_windows.bat | |
| ``` | |
| ### 4λ¨κ³: ν μ€νΈ | |
| ```cmd | |
| python test_gpu_deployment.py | |
| ``` | |
| ## π μ±κ³΅ νμΈ | |
| λ°°ν¬κ° μ±κ³΅μ μΌλ‘ μλ£λλ©΄ λ€μ μλΉμ€λ€μ΄ μ€νλ©λλ€: | |
| - β **Lily LLM API**: http://localhost:8001 | |
| - β **Hearth Chat**: http://localhost:8000 | |
| - β **LaTeX-OCR Service**: λ³λ 컨ν μ΄λλ‘ μ€ν | |
| - β **GPU κ°μ**: NVIDIA GPU νμ© | |
| - β **Hugging Face λͺ¨λΈ**: μ΅μ νλ λͺ¨λΈ λ‘λ |