yakul259 commited on
Commit
47a9d32
·
verified ·
1 Parent(s): 33bd645

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +76 -3
README.md CHANGED
@@ -1,3 +1,76 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ datasets:
4
+ - sweatSmile/FinanceQA
5
+ language:
6
+ - en
7
+ base_model:
8
+ - google-bert/bert-base-uncased
9
+ ---
10
+ # 💳 Credit Card Statement QA Model
11
+
12
+ **Model Name:** `yakul259/credit-statement-scraper`
13
+ **Base Model:** [`distilbert-base-uncased`](https://huggingface.co/distilbert-base-uncased)
14
+ **Task:** Question Answering (Extractive QA)
15
+ **Framework:** 🤗 Transformers
16
+ **Language:** English
17
+ **Author:** Yakul259
18
+ **License:** MIT
19
+
20
+ ---
21
+
22
+ ## 🧠 Model Overview
23
+
24
+ This model is a fine-tuned version of **DistilBERT** for **question answering** tasks, specifically designed to extract structured financial details from **credit card statements** in PDF or text format.
25
+
26
+ It was trained on a custom dataset of anonymized statements to recognize and answer questions like:
27
+ - “Which bank issued this statement?”
28
+ - “What is the billing cycle?”
29
+ - “What is the payment due date?”
30
+ - “What are the last 4 digits of the card?”
31
+ - “What is the total amount due?”
32
+
33
+ ---
34
+
35
+ ## 🏗️ Architecture
36
+
37
+ | Property | Value |
38
+ |-----------|--------|
39
+ | Model Type | DistilBERT |
40
+ | Architecture | DistilBertForQuestionAnswering |
41
+ | Hidden Size | 768 |
42
+ | Layers | 6 |
43
+ | Attention Heads | 12 |
44
+ | Max Sequence Length | 512 |
45
+ | Activation | GELU |
46
+ | Dropout | 0.1 |
47
+ | QA Dropout | 0.1 |
48
+ | Vocabulary Size | 30,522 |
49
+ | Transformers Version | 4.57.0 |
50
+
51
+ ---
52
+
53
+ ## 🧾 Example Usage
54
+
55
+ You can load this model directly using the `pipeline` API from 🤗 Transformers:
56
+
57
+ ```python
58
+ from transformers import pipeline
59
+
60
+ qa_pipeline = pipeline(
61
+ "question-answering",
62
+ model="yakul259/credit-statement-scraper",
63
+ tokenizer="yakul259/credit-statement-scraper"
64
+ )
65
+
66
+ context = """
67
+ Bank: XYZ Bank
68
+ Credit Card Number: **** **** **** 4321
69
+ Billing Period: 01/10/2025 - 31/10/2025
70
+ Payment Due Date: 15/11/2025
71
+ Total Amount Due: $1,254.67
72
+ """
73
+
74
+ question = "What is the payment due date?"
75
+ result = qa_pipeline(question=question, context=context)
76
+ print(result)