Update README.md
Browse files
README.md
CHANGED
|
@@ -5,6 +5,7 @@ base_model:
|
|
| 5 |
---
|
| 6 |
|
| 7 |
# Model Overview
|
|
|
|
| 8 |
This model is a multilingual Named Entity Recognition (NER) transformer designed for name
|
| 9 |
and address entity extraction with Malaysian context.
|
| 10 |
|
|
@@ -18,11 +19,13 @@ The model is built on top of Qwen3(Qwen3-0.6B) and uses a custom non-causal atte
|
|
| 18 |
mechanism.
|
| 19 |
|
| 20 |
## Predicted Classes
|
|
|
|
| 21 |
- 0 : Non-entity token
|
| 22 |
- 1 : Name entity
|
| 23 |
- 2 : Address entity
|
| 24 |
|
| 25 |
## Transformer Inference Example
|
|
|
|
| 26 |
```python
|
| 27 |
from transformers import AutoTokenizer, Qwen3ForTokenClassification, AttentionInterface
|
| 28 |
from typing import Optional
|
|
@@ -106,4 +109,9 @@ with toch.no_grad():
|
|
| 106 |
```
|
| 107 |
|
| 108 |
## Evaluation Result
|
| 109 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5 |
---
|
| 6 |
|
| 7 |
# Model Overview
|
| 8 |
+
|
| 9 |
This model is a multilingual Named Entity Recognition (NER) transformer designed for name
|
| 10 |
and address entity extraction with Malaysian context.
|
| 11 |
|
|
|
|
| 19 |
mechanism.
|
| 20 |
|
| 21 |
## Predicted Classes
|
| 22 |
+
|
| 23 |
- 0 : Non-entity token
|
| 24 |
- 1 : Name entity
|
| 25 |
- 2 : Address entity
|
| 26 |
|
| 27 |
## Transformer Inference Example
|
| 28 |
+
|
| 29 |
```python
|
| 30 |
from transformers import AutoTokenizer, Qwen3ForTokenClassification, AttentionInterface
|
| 31 |
from typing import Optional
|
|
|
|
| 109 |
```
|
| 110 |
|
| 111 |
## Evaluation Result
|
| 112 |
+
|
| 113 |
+
- F1 macro: 0.81
|
| 114 |
+
|
| 115 |
+
## Optimized inference
|
| 116 |
+
|
| 117 |
+
We build small dynamic batching library for this, https://github.com/Scicom-AI-Enterprise-Organization/entity-api
|