shawhin/phishing-site-classification
Viewer • Updated • 3k • 252 • 7
How to use shawhin/bert-phishing-classifier_student_4bit with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-classification", model="shawhin/bert-phishing-classifier_student_4bit") # Load model directly
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tokenizer = AutoTokenizer.from_pretrained("shawhin/bert-phishing-classifier_student_4bit")
model = AutoModelForSequenceClassification.from_pretrained("shawhin/bert-phishing-classifier_student_4bit")This model is a quantized version of shawhin/bert-phishing-classifier_student trained via knowledge distillation from shawhin/bert-phishing-classifier_teacher using the shawhin/phishing-site-classification dataset. It achieves the following results on the validation set:
Quantized student model for model compression example.
Video | Blog | Example code
This model was created for educational purposes.
The Training, Testing, and Validation data are available here: shawhin/phishing-site-classification.
Base model
distilbert/distilbert-base-uncased