Simon commited on
Commit
d228066
·
1 Parent(s): a9f0e5a

Model evealuation (#11)

Browse files

* Add model selection script and evaluation metrics for phishing detection

* Add modular components for phishing detection model training and evaluation

* Add training script for phishing detection model with extensive hyperparameter search and Hopsworks integration

* Add workflow for training final model with hyperparameter search and Hopsworks integration

* Refactor import statements to use src directory structure for URL scanning and sitemap extraction

* Refactor import statements to align with src directory structure for data preprocessing

* fix to the pipline

.github/workflows/scheduled_data_pipeline.yml CHANGED
@@ -87,7 +87,7 @@ jobs:
87
  HOPSWORKS_API_KEY: ${{ secrets.HOPSWORKS_API_KEY }}
88
  HOPSWORKS_PROJECT_NAME: ${{ secrets.HOPSWORKS_PROJECT_NAME }}
89
  run: |
90
- uv run python src/phising_detection/features/batch_url_scanner.py \
91
  --fg1-name phishing_urls \
92
  --fg1-version 2 \
93
  --fg2-name legit_urls_before_scan \
 
87
  HOPSWORKS_API_KEY: ${{ secrets.HOPSWORKS_API_KEY }}
88
  HOPSWORKS_PROJECT_NAME: ${{ secrets.HOPSWORKS_PROJECT_NAME }}
89
  run: |
90
+ uv run python -m src.phising_detection.features.batch_url_scanner \
91
  --fg1-name phishing_urls \
92
  --fg1-version 2 \
93
  --fg2-name legit_urls_before_scan \