| | --- |
| | license: apache-2.0 |
| | language: |
| | - en |
| | metrics: |
| | - accuracy |
| | library_name: transformers |
| | pipeline_tag: text-classification |
| | datasets: |
| | - GautamR/grievance_agri |
| | --- |
| | # Grievance Classification Model |
| |
|
| | This model classifies grievances into five distinct buckets: |
| |
|
| | - **Label 0**: Account number is not Correct |
| | - **Label 1**: Installment not received |
| | - **Label 2**: Others |
| | - **Label 3**: convo_starter |
| | - **Label 4**: convo_ender |
| |
|
| | ## Description of the Buckets |
| |
|
| | 1. **Account number is not Correct**: |
| | This pertains to feedback or grievances related to the bank account number not being displayed correctly on the portal for farmers. |
| |
|
| | 2. **Installment not received**: |
| | This pertains to feedback where the farmer has not received the installment or money for a given month. |
| |
|
| | 3. **Others**: |
| | This covers a broad range of other grievances including, but not limited to: |
| | - Gender being displayed incorrectly |
| | - Online application pending approval |
| | - Other payment-related issues |
| | - Problem with Aadhaar correction |
| | - Issue with biometric-based e-KYC |
| | - Issue with OTP-based e-KYC |
| | - Transaction failures |
| |
|
| | 4. **Convo_starter**: |
| | Any phrase that could be a conversation starter like 'Hi','Hello','Namasthe' |
| | |
| | 5. **Convo_ender**: |
| | Any phrase that could signal the end of a conversation like 'Thank you','Goodbye' |
| |
|
| | ## Training code: |
| | The code for training the model can be found [here](https://colab.research.google.com/drive/16ThlfaBKTAS3ZfUXQSaXvjAJie754gBg#scrollTo=ksdtTs6Naqxm) |
| |
|
| | ## Training Metrics |
| |
|
| | The following training metrics were observed over 15 epochs: |
| |
|
| | | Epoch | Loss | Accuracy | F1 Score | |
| | |-------|---------|----------|----------| |
| | | 1 | 1.0574 | 0.4242 | 0.4202 | |
| | | 2 | 0.7780 | 0.7500 | 0.6952 | |
| | | 3 | 0.5212 | 0.8939 | 0.8825 | |
| | | 4 | 0.3214 | 0.9773 | 0.9767 | |
| | | 5 | 0.1612 | 1.0000 | 1.0000 | |
| | | 6 | 0.0883 | 1.0000 | 1.0000 | |
| | | 7 | 0.0592 | 1.0000 | 1.0000 | |
| | | 8 | 0.0418 | 1.0000 | 1.0000 | |
| | | 9 | 0.0321 | 1.0000 | 1.0000 | |
| |
|
| | --- |
| |
|
| |
|
| |
|
