File size: 3,540 Bytes
400950c f5fddd0 8725134 f5fddd0 8725134 f5fddd0 8725134 f5fddd0 af1a69e f5fddd0 8725134 af1a69e f5fddd0 8725134 f5fddd0 863505e f5fddd0 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 | ---
language: en
license: mit
tags:
- text-classification
- pytorch
---
# Comments Classifier (RuBERT fine-tune)
A Russian-language comment classification model fine-tuned on top of **RuBERT**. Developed as part of the Lubarsky Comments Model project.
## Overview
The model was fine-tuned on a labeled dataset of Russian-language comments. Its goal is to automatically determine the category/type of a given comment.
The repository contains three ready-to-use **standalone applications** built with **PyInstaller** β no Python installation or dependencies required:
| File | Size | Description |
|---|---|---|
| `trainer.zip` | ~2.6 GB | Application for fine-tuning the model |
| `prediction.zip` | ~2.5 GB | Application for running predictions |
| `classifier.zip` | ~60 MB | Application for manual comment classification |
| `QA_dataset.csv` | ~75 kB | Quality assurance dataset |
---
## Quick Start
> β οΈ **No Python installation required** β all three programs are self-contained `.exe` applications.
### 1. Download the ZIP archive
Download one or more archives from this page.
### 2. Extract the archive
Extract the downloaded archive to a convenient location. The folder structure will look like this:
```
classifier/
βββ _internal/ # internal dependencies (do not modify)
βββ run_classifier.exe # executable file
```
### 3. Run the `.exe`
Simply double-click the `.exe` file or launch it from the terminal:
```bash
.\run_classifier.exe
.\run_prediction.exe
.\run_trainer.exe
```
---
## Application Descriptions
**`run_classifier`** β a tool for manual or batch comment classification. Useful for quick review and labeling.
**`run_prediction`** β the main inference application. Takes comments as input and returns predicted classes.
**`run_trainer`** β fine-tunes the model on new data. Allows you to retrain the classifier on your own dataset.
---
## Environment Configuration
The repository includes a `.env` file with environment variables (e.g., file paths, parameters). Edit it as needed before running the applications.
---
## Source Code
The full source code (training, data labeling, scripts) is available on GitHub:
π [gerageragera39/Lubarsky_Comments_Model](https://github.com/gerageragera39/Lubarsky_Comments_Model)
Source repository structure:
- `data_hand_classifier/` β tools for manual data labeling
- `rubert_trainer/` β RuBERT fine-tuning scripts
- `dataset.csv` β main training dataset
- `test_comments.csv` β test set
- `result.png` β training results visualization
---
## Technical Details
- **Base model:** RuBERT (DeepPavlov)
- **Framework:** PyTorch + HuggingFace Transformers
- **Build:** PyInstaller (standalone Windows executables)
- **Data language:** Russian
- **Task:** Text Classification
---
## License
This project is released under the [MIT License](https://opensource.org/licenses/MIT).
You are free to use, modify, and distribute this software for both personal and commercial purposes, provided that the original copyright notice is retained.
> **Note:** Since the applications are packaged with PyInstaller, they may be flagged by antivirus software as suspicious. This is a known false positive common to PyInstaller-built executables. You may need to add an exception in your antivirus or temporarily disable it to run the applications.
The software is provided **as is**, without warranty of any kind. The author takes no responsibility for any issues, damages, or data loss that may arise from its use.
|