tlemagueresse commited on
Commit
5585a48
Β·
1 Parent(s): c53eedd

update readme

Browse files
Files changed (2) hide show
  1. README.md +52 -0
  2. packages.txt +0 -1
README.md CHANGED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: "Adaptive T5 Summarization"
3
+ emoji: πŸ“
4
+ colorFrom: blue
5
+ colorTo: indigo
6
+ sdk: docker
7
+ app_file: ""
8
+ ---
9
+
10
+ # Adaptive T5 Summarization
11
+
12
+ This project builds a meta-model on top of T5 to adapt model selection based on text complexity.
13
+
14
+ ## Installation
15
+
16
+ To use this project, clone the repository and install the required dependencies:
17
+
18
+ ```bash
19
+ git clone https://huggingface.co/spaces/your_space_name
20
+ cd your_space_name
21
+ pip install -r requirements.txt
22
+ python -m spacy download en_core_web_lg
23
+ ```
24
+
25
+
26
+ ## Repository Structure
27
+ ```bash
28
+ .
29
+ β”œβ”€β”€ demo.ipynb # Jupyter notebook demonstrating the usage.
30
+ β”œβ”€β”€ model.py # Contains the T5 models and the meta-model implementation.
31
+ β”œβ”€β”€ requirements.txt # Lists the required Python packages.
32
+ β”œβ”€β”€ LICENSE
33
+ └── README.md
34
+ ```
35
+
36
+ ## Usage
37
+ What the meta model does:
38
+ - Extract complexity-based features from input texts.
39
+ - Apply multiple T5-based summarization models.
40
+ - Use BertScore to determine the best-performing model for each text.
41
+ - Train a classifier to predict the best model based on extracted features.
42
+ - At inference, the classifier selects the appropriate model dynamically.
43
+
44
+ ## TODO
45
+ The results are not satisfactory. Improvements should be made:
46
+
47
+ - Reduce the tolerance (the small model is nearly always used).
48
+ - Include feature computation time in the meta-model cost analysis.
49
+ - Analyze feature relevance and classifier performance more deeply.
50
+ - Modify the MetaModel structure since it is too large to commit (4GB).
51
+
52
+ This is an ongoing project, and contributions or feedback are welcome!
packages.txt DELETED
@@ -1 +0,0 @@
1
- python -m spacy download en_core_web_lg