Upload MPE v4.0 Model, Tokenizer, Categories, and ONNX export

README.md

@@ -0,0 +1,35 @@
+
+---
+language: en
+tags:
+- torrent
+- usenet
+- metadata-extraction
+- title-extraction
+- span-prediction
+- onnx
+license: mit
+---
+
+# MPE Engine v4.0 (Metadata Probability Extraction Engine)
+
+This model is a token classification and span extraction transformer designed to parse release names from Torrents and Usenet. 
+It uses an **Atomic Normalization Layer** to compress relational metadata (like `Season 1-5 Complete` or `S01E02-E04`) into single, unbreakable tokens before passing them to a MiniLM encoder.
+
+## Architecture
+- **Backbone:** sentence-transformers/all-MiniLM-L6-v2
+- **Head 1 (Binary):** Is the token metadata? (BCE Loss)
+- **Head 2 (Category):** What type of metadata? (Cross-Entropy Loss)
+- **Head 3 & 4 (Span):** Start/End position of the Title (Cross-Entropy Loss)
+
+## Capabilities
+- Extracts titles cleanly from Western, Anime, K-Drama, and Indian OTT release styles.
+- Resists breaking on ambiguous titles like `1923`, `It`, `DV`, `From`.
+- Supports exhaustive ISO languages (3-letter codes like `tam`, `kor`).
+- Handles complete pack ranges, daily episodes, and multi-episode ranges.
+
+## Files Included
+- `mpe_model.onnx`: The production-ready ONNX export for <10ms CPU inference.
+- `pytorch_model.bin`: The native PyTorch weights.
+- `tokenizer/`: The WordPiece tokenizer vocabulary.
+- `categories.json`: The hierarchical category mapping.

categories.json

@@ -0,0 +1,27 @@
+{
+  "TITLE": 0,
+  "UNKNOWN": 1,
+  "SEASON": 2,
+  "SEASON_RANGE": 3,
+  "EPISODE_NUMBER": 4,
+  "EPISODE_RANGE": 5,
+  "COMPLETE_PACK": 6,
+  "PART_VOLUME": 7,
+  "YEAR": 8,
+  "RESOLUTION": 9,
+  "SOURCE": 10,
+  "VIDEO_CODEC": 11,
+  "AUDIO_CODEC": 12,
+  "AUDIO_CHANNELS": 13,
+  "HDR": 14,
+  "RELEASE_GROUP": 15,
+  "EDITION": 16,
+  "BIT_DEPTH": 17,
+  "FRAMERATE": 18,
+  "LANGUAGE": 19,
+  "ANIME_TERM": 20,
+  "VOLUME": 21,
+  "COUR": 22,
+  "FINAL_SEASON": 23,
+  "WEBSITE": 24
+}

mpe_model_fp32.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a69d4854e3a1e22b8c5d003af09ede4fa4347ac84961efaf49d0504d6fb1803c
+size 90429299

mpe_model_int8.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:47185beff8d8405af5c9fe77569ba80f23a810f76e0aa97fe85c114647b7444d
+size 22895985

pytorch_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a734fc1ce84617b547878003841e419e7ea0acdbfec9de90455120e66764084e
+size 90942367

tokenizer/tokenizer_config.json

@@ -0,0 +1,16 @@
+{
+  "backend": "tokenizers",
+  "cls_token": "[CLS]",
+  "do_basic_tokenize": true,
+  "do_lower_case": true,
+  "is_local": false,
+  "mask_token": "[MASK]",
+  "model_max_length": 512,
+  "never_split": null,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "BertTokenizer",
+  "unk_token": "[UNK]"
+}