README.md

metadata

title: Log Classification System
emoji: 🔍
colorFrom: blue
colorTo: indigo
sdk: gradio
sdk_version: 5.23.0
app_file: app.py
pinned: false
license: mit

🔍 Log Classification System

A production-inspired hybrid log classification pipeline that routes enterprise logs through 3 tiers — Regex → BERT + Logistic Regression → LLM — based on pattern confidence and source system.

Architecture

Input Log
    │
    ├─► [Tier 1] Regex Classifier      → Fixed patterns (sub-ms latency)
    │         │ No match?
    │         ▼
    ├─► [Tier 2] BERT + LogReg         → High-confidence ML (conf > 0.5)
    │         │ Low confidence?
    │         ▼
    └─► [Tier 3] LLM (HF Inference)   → LegacyCRM / rare patterns

Categories

Category	Tier Used
User Action	Regex
System Notification	Regex
HTTP Status	BERT
Security Alert	BERT
Critical Error	BERT
Error	BERT
Resource Usage	BERT
Workflow Error	LLM
Deprecation Warning	LLM

Setup

HuggingFace Spaces Secrets Required

• HF_TOKEN — your HuggingFace token (for LLM inference on LegacyCRM logs)

Local Setup

pip install -r requirements.txt
python app.py

Source Systems

• ModernCRM, ModernHR, BillingSystem, AnalyticsEngine, ThirdPartyAPI → Regex → BERT
• LegacyCRM → LLM directly (too few training samples for ML)

Tech Stack

sentence-transformers · scikit-learn · huggingface-hub · gradio · pandas