File size: 8,803 Bytes
f203641 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 |
# OktoEngine FAQ
Frequently Asked Questions about OktoEngine CLI.
---
## General Questions
### Q: What is OktoEngine?
**A:** OktoEngine is the official execution engine for OktoScript—a professional CLI tool that transforms declarative AI configurations into trained, production-ready models. It provides a complete command-line interface for training, evaluating, and exporting AI models.
### Q: Do I need to know Python to use OktoEngine?
**A:** No! OktoEngine provides a complete CLI interface. You only need to write OktoScript configuration files. The engine handles all the complex operations behind the scenes.
### Q: What models can I train with OktoEngine?
**A:** OktoEngine supports any model compatible with modern AI frameworks. From small models (millions of parameters) to large language models (billions of parameters). The engine automatically handles model loading, training, and optimization.
### Q: Is OktoEngine free?
**A:** OktoEngine binary releases are available for download. See the [LICENSE](../LICENSE) file for licensing terms.
---
## Installation & Setup
### Q: How do I install OktoEngine?
**A:** Download the latest release from [GitHub Releases](https://github.com/oktoseek/oktoengine/releases) for your platform:
- Windows: `okto-windows.exe`
- Linux: `okto-linux`
- macOS: `okto-macos`
Make it executable (Linux/Mac) and optionally add to PATH.
### Q: How do I update OktoEngine?
**A:** Simply run:
```bash
okto upgrade
```
This automatically downloads and installs the latest version.
### Q: What are the system requirements?
**A:**
- **Minimum:** 8GB RAM, 10GB storage, compatible runtime
- **Recommended for training:** GPU with CUDA, 32GB+ RAM, 50GB+ SSD storage
Check your system:
```bash
okto doctor
```
---
## Training
### Q: Can I train models without a GPU?
**A:** Yes! OktoEngine automatically detects available hardware and uses CPU when GPU is not available. Training will be slower but fully functional. Set `device: "auto"` in your TRAIN block for automatic detection.
### Q: How long does training take?
**A:** Training time depends on:
- Model size (parameters)
- Dataset size
- Hardware (GPU/CPU)
- Number of epochs
**Rough estimates:**
- Small models (100M params): 5-15 minutes
- Medium models (1B params): 30-60 minutes
- Large models (7B params): Several hours
### Q: Can I resume training from a checkpoint?
**A:** Yes! OktoEngine automatically saves checkpoints during training. You can resume from any checkpoint by configuring your OktoScript file.
### Q: What if training fails?
**A:**
1. Check system: `okto doctor`
2. Validate configuration: `okto validate --debug`
3. Check error messages for specific issues
4. Common fixes:
- Reduce `batch_size` if out of memory
- Verify dataset paths exist
- Check model name is valid
- Install missing dependencies: `okto doctor --install`
---
## Configuration
### Q: How do I validate my OktoScript file?
**A:**
```bash
okto validate
```
Or with debug mode:
```bash
okto validate --debug
```
### Q: What if validation fails?
**A:**
1. Enable debug mode: `okto validate --debug`
2. Check error messages
3. Verify syntax matches OktoScript grammar
4. Check file paths exist
5. Verify values are within allowed ranges
### Q: Can I use models from HuggingFace?
**A:** Yes! OktoEngine automatically downloads models from HuggingFace. Just specify the model identifier in your MODEL block:
```okt
MODEL {
base: "gpt2" # Downloads automatically
}
```
### Q: What export formats are supported?
**A:** OktoEngine supports multiple formats:
- `okm` - OktoSeek Model format (optimized)
- `onnx` - ONNX format (universal)
- `gguf` - GGUF format (local inference)
- `safetensors` - SafeTensors format (HuggingFace)
---
## Debug Mode
### Q: What is debug mode?
**A:** Debug mode provides detailed, real-time logging of OktoEngine's internal operations. It shows parsing details, execution flow, and error diagnostics.
### Q: How do I enable debug mode?
**A:**
```bash
okto train --debug
okto validate --debug
```
Or via environment variable:
```bash
OKTO_DEBUG=1 okto train
```
### Q: When should I use debug mode?
**A:** Use debug mode when:
- Troubleshooting parsing errors
- Understanding execution flow
- Performance analysis
- Configuration debugging
---
## System & Dependencies
### Q: How do I check my system?
**A:**
```bash
okto doctor
```
Shows GPU, CUDA, RAM, runtime, and dependencies.
### Q: How do I install missing dependencies?
**A:**
```bash
okto doctor --install
```
Automatically installs missing dependencies.
### Q: What dependencies are required?
**A:** OktoEngine automatically manages dependencies. Required packages are installed automatically when needed. Check with:
```bash
okto doctor
```
---
## Errors & Troubleshooting
### Q: Training fails with "Model not found"
**A:**
1. Check the model name in MODEL block is valid
2. Verify it's a valid HuggingFace model identifier
3. Check internet connection (for downloading)
4. Try a different model: `gpt2`, `distilgpt2`, etc.
### Q: Training fails with "Dataset not found"
**A:**
1. Verify dataset paths in DATASET block
2. Check files exist at specified paths
3. Use absolute paths if relative paths fail
4. Verify file format (JSONL, CSV, etc.)
### Q: Training fails with "Out of memory"
**A:**
1. Reduce `batch_size` in TRAIN block
2. Use LoRA fine-tuning instead of full fine-tuning
3. Reduce model size
4. Close other applications
5. Use CPU if GPU memory is insufficient
### Q: Validation fails with syntax error
**A:**
1. Enable debug mode: `okto validate --debug`
2. Check OktoScript syntax matches grammar
3. Verify all required blocks are present
4. Check for typos in block names
5. Verify quotes around string values
---
## Performance
### Q: How can I speed up training?
**A:**
1. Use GPU: Set `accelerator: "gpu"` in ENV block
2. Use mixed precision: Set `precision: "fp16"` in ENV block
3. Increase batch size (if memory allows)
4. Use LoRA fine-tuning for large models
5. Use SSD storage for datasets
### Q: How do I monitor training progress?
**A:** Training progress is shown in real-time in the terminal:
- Progress bars
- Loss values
- Learning rate
- GPU memory usage
- Epoch progress
### Q: Can I train multiple models simultaneously?
**A:** Yes, but ensure you have sufficient resources (GPU memory, RAM). Run training in separate terminals or use different GPU devices.
---
## Integration
### Q: Will OktoEngine be integrated into OktoSeek IDE?
**A:** Yes! OktoEngine will be integrated into OktoSeek IDE for visual training workflows, including:
- Visual pipeline builder
- Real-time dashboard
- One-click training
- Project management
### Q: Can I use OktoEngine in scripts?
**A:** Yes! OktoEngine is designed for CLI usage and can be integrated into scripts, CI/CD pipelines, and automation workflows.
---
## Licensing
### Q: Is OktoEngine open source?
**A:** No. OktoEngine is proprietary software. Binary releases are available for download, but the source code is proprietary. See [LICENSE](../LICENSE) for details.
### Q: Can I redistribute OktoEngine?
**A:** See the [LICENSE](../LICENSE) file for redistribution terms.
---
## Support
### Q: Where can I get help?
**A:**
- **Documentation:** Check [docs/](./) folder
- **GitHub Issues:** https://github.com/oktoseek/oktoengine/issues
- **Email:** service@oktoseek.com
- **Website:** https://www.oktoseek.com
### Q: How do I report a bug?
**A:**
1. Open an issue on [GitHub](https://github.com/oktoseek/oktoengine/issues)
2. Include:
- OktoEngine version: `okto --version`
- System information: `okto doctor`
- Error messages
- Steps to reproduce
- Debug output (if applicable)
---
## Advanced
### Q: Can I customize training behavior?
**A:** Yes, through OktoScript configuration:
- Training parameters (epochs, batch size, learning rate)
- Optimizer settings
- Scheduler configuration
- Checkpoint settings
- Export formats
### Q: Can I use custom datasets?
**A:** Yes! OktoEngine supports multiple dataset formats:
- JSONL (recommended)
- CSV
- TXT
- Parquet
Just specify the path in your DATASET block.
### Q: How do I export to multiple formats?
**A:**
```okt
EXPORT {
format: ["okm", "onnx", "gguf"]
path: "export/"
}
```
---
**Need more help?** Check the [Getting Started Guide](./GETTING_STARTED.md) or [CLI Reference](./CLI_REFERENCE.md).
|