Retreino automático via pipeline Foxy

README.md

@@ -1,87 +1,25 @@
 ---
-library_name: transformers
-license: mit
-base_model: neuralmind/bert-large-portuguese-cased
+language: pt
+license: apache-2.0
+pipeline_tag: text-classification
 tags:
-- generated_from_trainer
-metrics:
-- accuracy
-model-index:
-- name: foxy-nlp-br
-  results: []
+- portuguese
+- text-classification
+- customer-support
+- foxy
 ---
 
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
+# Foxy NLP BR
 
-# foxy-nlp-br
+Modelo de classificação de intenções treinado para roteamento N1 e extração de dados.
 
-This model is a fine-tuned version of [neuralmind/bert-large-portuguese-cased](https://huggingface.co/neuralmind/bert-large-portuguese-cased) on the None dataset.
-It achieves the following results on the evaluation set:
-- Loss: 0.1638
-- Accuracy: 0.9714
-- F1 Weighted: 0.9714
-- F1 Macro: 0.9740
-- F1 Saudacao: 1.0
-- F1 Cancelamento: 1.0
-- F1 Reclamacao: 0.8824
-- F1 Financeiro: 1.0
-- F1 Suporte Tecnico: 0.9545
-- F1 Elogio: 0.9412
-- F1 Informacao: 1.0
-- F1 Pedido Entrega: 1.0
-- F1 Conta Perfil: 0.9615
-- F1 Negociacao Retencao: 1.0
-- F1 Min Class: 0.8824
-
-## Model description
-
-More information needed
-
-## Intended uses & limitations
-
-More information needed
-
-## Training and evaluation data
-
-More information needed
-
-## Training procedure
-
-### Training hyperparameters
-
-The following hyperparameters were used during training:
-- learning_rate: 4.197342969974621e-05
-- train_batch_size: 16
-- eval_batch_size: 8
-- seed: 42
-- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
-- lr_scheduler_type: linear
-- lr_scheduler_warmup_steps: 0.0022118889184775006
-- num_epochs: 22
-
-### Training results
-
-| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 Weighted | F1 Macro | F1 Saudacao | F1 Cancelamento | F1 Reclamacao | F1 Financeiro | F1 Suporte Tecnico | F1 Elogio | F1 Informacao | F1 Pedido Entrega | F1 Conta Perfil | F1 Negociacao Retencao | F1 Min Class |
-|:-------------:|:-----:|:----:|:---------------:|:--------:|:-----------:|:--------:|:-----------:|:---------------:|:-------------:|:-------------:|:------------------:|:---------:|:-------------:|:-----------------:|:---------------:|:----------------------:|:------------:|
-| 0.8071        | 1.0   | 125  | 0.8255          | 0.7943   | 0.7724      | 0.7549   | 0.8966      | 0.7059          | 0.7692        | 0.7619        | 0.8261             | 0.9143    | 0.75          | 0.9375            | 0.8333          | 0.1538                 | 0.1538       |
-| 0.2542        | 2.0   | 250  | 0.3204          | 0.9257   | 0.9254      | 0.9301   | 0.9630      | 0.9714          | 0.8824        | 1.0           | 0.8837             | 0.9412    | 0.8421        | 0.9375            | 0.9231          | 0.9565                 | 0.8421       |
-| 0.0880        | 3.0   | 375  | 0.2739          | 0.9314   | 0.9306      | 0.9334   | 0.9286      | 1.0             | 0.8824        | 1.0           | 0.9048             | 0.9412    | 0.8571        | 0.9375            | 0.9259          | 0.9565                 | 0.8571       |
-| 0.0176        | 4.0   | 500  | 0.2407          | 0.9486   | 0.9482      | 0.9519   | 1.0         | 1.0             | 0.8824        | 1.0           | 0.9048             | 0.9412    | 0.9231        | 0.9677            | 0.9434          | 0.9565                 | 0.8824       |
-| 0.0129        | 5.0   | 625  | 0.2209          | 0.9543   | 0.9541      | 0.9563   | 1.0         | 1.0             | 0.8824        | 1.0           | 0.9302             | 0.9412    | 0.9231        | 0.9677            | 0.9615          | 0.9565                 | 0.8824       |
-| 0.0072        | 6.0   | 750  | 0.2345          | 0.9543   | 0.9541      | 0.9569   | 1.0         | 1.0             | 0.8824        | 1.0           | 0.9302             | 0.9412    | 0.9474        | 0.9677            | 0.9434          | 0.9565                 | 0.8824       |
-| 0.0085        | 7.0   | 875  | 0.2161          | 0.96     | 0.9599      | 0.9638   | 1.0         | 1.0             | 0.8824        | 1.0           | 0.9302             | 0.9412    | 0.9730        | 0.9677            | 0.9434          | 1.0                    | 0.8824       |
-| 0.0061        | 8.0   | 1000 | 0.2211          | 0.96     | 0.9599      | 0.9638   | 1.0         | 1.0             | 0.8824        | 1.0           | 0.9302             | 0.9412    | 0.9730        | 0.9677            | 0.9434          | 1.0                    | 0.8824       |
-| 0.0076        | 9.0   | 1125 | 0.1966          | 0.96     | 0.9599      | 0.9638   | 1.0         | 1.0             | 0.8824        | 1.0           | 0.9302             | 0.9412    | 0.9730        | 0.9677            | 0.9434          | 1.0                    | 0.8824       |
-| 0.0053        | 10.0  | 1250 | 0.1642          | 0.9714   | 0.9714      | 0.9740   | 1.0         | 1.0             | 0.8824        | 1.0           | 0.9545             | 0.9412    | 1.0           | 1.0               | 0.9615          | 1.0                    | 0.8824       |
-| 0.0069        | 11.0  | 1375 | 0.1517          | 0.9657   | 0.9657      | 0.9680   | 1.0         | 1.0             | 0.8824        | 1.0           | 0.9545             | 0.9412    | 0.9730        | 0.9677            | 0.9615          | 1.0                    | 0.8824       |
-| 0.0049        | 12.0  | 1500 | 0.1775          | 0.96     | 0.9599      | 0.9638   | 1.0         | 1.0             | 0.8824        | 1.0           | 0.9302             | 0.9412    | 0.9730        | 0.9677            | 0.9434          | 1.0                    | 0.8824       |
-| 0.0051        | 13.0  | 1625 | 0.1730          | 0.9657   | 0.9657      | 0.9680   | 1.0         | 1.0             | 0.8824        | 1.0           | 0.9545             | 0.9412    | 0.9730        | 0.9677            | 0.9615          | 1.0                    | 0.8824       |
-
-
-### Framework versions
-
-- Transformers 5.3.0
-- Pytorch 2.10.0+cu128
-- Datasets 3.0.0
-- Tokenizers 0.22.2
+## Labels Identificadas no Treino:
+- `CANCELAMENTO`
+- `CONTA_PERFIL`
+- `ELOGIO`
+- `FINANCEIRO`
+- `INFORMACAO`
+- `PEDIDO_ENTREGA`
+- `RECLAMACAO`
+- `SAUDACAO`
+- `SUPORTE_TECNICO`

config.json

@@ -7,43 +7,41 @@
   "bos_token_id": null,
   "classifier_dropout": null,
   "directionality": "bidi",
-  "dtype": "bfloat16",
+  "dtype": "float32",
   "eos_token_id": null,
   "hidden_act": "gelu",
   "hidden_dropout_prob": 0.1,
-  "hidden_size": 1024,
+  "hidden_size": 768,
   "id2label": {
-    "0": "SAUDACAO",
-    "1": "CANCELAMENTO",
-    "2": "RECLAMACAO",
+    "0": "CANCELAMENTO",
+    "1": "CONTA_PERFIL",
+    "2": "ELOGIO",
     "3": "FINANCEIRO",
-    "4": "SUPORTE_TECNICO",
-    "5": "ELOGIO",
-    "6": "INFORMACAO",
-    "7": "PEDIDO_ENTREGA",
-    "8": "CONTA_PERFIL",
-    "9": "NEGOCIACAO_RETENCAO"
+    "4": "INFORMACAO",
+    "5": "PEDIDO_ENTREGA",
+    "6": "RECLAMACAO",
+    "7": "SAUDACAO",
+    "8": "SUPORTE_TECNICO"
   },
   "initializer_range": 0.02,
-  "intermediate_size": 4096,
+  "intermediate_size": 3072,
   "is_decoder": false,
   "label2id": {
-    "CANCELAMENTO": 1,
-    "CONTA_PERFIL": 8,
-    "ELOGIO": 5,
+    "CANCELAMENTO": 0,
+    "CONTA_PERFIL": 1,
+    "ELOGIO": 2,
     "FINANCEIRO": 3,
-    "INFORMACAO": 6,
-    "NEGOCIACAO_RETENCAO": 9,
-    "PEDIDO_ENTREGA": 7,
-    "RECLAMACAO": 2,
-    "SAUDACAO": 0,
-    "SUPORTE_TECNICO": 4
+    "INFORMACAO": 4,
+    "PEDIDO_ENTREGA": 5,
+    "RECLAMACAO": 6,
+    "SAUDACAO": 7,
+    "SUPORTE_TECNICO": 8
   },
   "layer_norm_eps": 1e-12,
   "max_position_embeddings": 512,
   "model_type": "bert",
-  "num_attention_heads": 16,
-  "num_hidden_layers": 24,
+  "num_attention_heads": 12,
+  "num_hidden_layers": 12,
   "output_past": true,
   "pad_token_id": 0,
   "pooler_fc_size": 768,
@@ -53,7 +51,7 @@
   "pooler_type": "first_token_transform",
   "problem_type": "single_label_classification",
   "tie_word_embeddings": true,
-  "transformers_version": "5.3.0",
+  "transformers_version": "5.0.0",
   "type_vocab_size": 2,
   "use_cache": false,
   "vocab_size": 29794

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9c844ae87e6d8bcc30cfd0ac44be8d5646339e140379fdfe7a29123668e64f80
-size 668860420
+oid sha256:69176e9b302ee2c6ed9bbe45587f44b36bc91ce28620e0e9abfb0bde4e9bfd4f
+size 435743732

tokenizer.json

@@ -1,7 +1,21 @@
 {
   "version": "1.0",
-  "truncation": null,
-  "padding": null,
+  "truncation": {
+    "direction": "Right",
+    "max_length": 128,
+    "strategy": "LongestFirst",
+    "stride": 0
+  },
+  "padding": {
+    "strategy": {
+      "Fixed": 128
+    },
+    "direction": "Right",
+    "pad_to_multiple_of": null,
+    "pad_id": 0,
+    "pad_type_id": 0,
+    "pad_token": "[PAD]"
+  },
   "added_tokens": [
     {
       "id": 0,

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1523987fb11f96d5f9556324310fb96ac62b5249b411b414ee81c0c554680111
-size 5265
+oid sha256:db048dd129bb12446d1f54b61d4c4adfba4e3956c7d13fecb40b73ad63539b9c
+size 5201