| | --- |
| | license: mit |
| | datasets: |
| | - CooperW/jadidi |
| | base_model: |
| | - unsloth/gemma-2-27b-bnb-4bit |
| | --- |
| | This model has been trained for multi classification of the TON-Iot Network dataset. |
| |
|
| | Refer to adapter_config.json for LoRa Parameters. |
| | |
| | Accuracy: 95.6% |
| | |
| | Key Training Params: |
| | |
| | * Steps: 100 |
| | * Batch Size: 64 |
| | * Optimizer: Adam_8bit |
| | * lr_schedular: cosine_with_restarts |
| | * lr_scheduler_kwargs = { "num_cycles": len(trainer.get_train_dataloader()) / 100 } |
| |
|
| | The datasets are an 80/20 partition of the TON-Iot Network dataset. |
| |
|
| | Train Dataset: |
| | * train_network_multi.jsonl |
| |
|
| | Test Dataset: |
| | * test_network_multi.jsonl |
