Aqsa Kausar
commited on
Update README.md
Browse files
README.md
CHANGED
|
@@ -23,7 +23,7 @@ This projects aims to monitor in-demand skills for machine learning roles. Skill
|
|
| 23 |
### [Monitoring Platform Link](https://huggingface.co/spaces/Robzy/jobbert_knowledge_extraction)
|
| 24 |
|
| 25 |
<h2>
|
| 26 |
-
<img src="./images/
|
| 27 |
Architecture & Frameworks
|
| 28 |
</h2>
|
| 29 |
|
|
@@ -35,14 +35,21 @@ This projects aims to monitor in-demand skills for machine learning roles. Skill
|
|
| 35 |
|
| 36 |
|
| 37 |
# High-Level Overview
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
|
| 39 |
-
## Models
|
| 40 |
* **BERT** - finetuned skill extraction model, lightweight.
|
| 41 |
* **LLM** - gpt-4o for skill extraction with multi-shot learning. Computationally expensive.
|
| 42 |
* **Embedding model** - [SentenceTransformers](https://sbert.net/) used to embed skills into vectors.
|
| 43 |
* [**spaCy**](https://spacy.io/models/en#en_core_web_sm) - sentence tokenization model.
|
| 44 |
|
| 45 |
## Pipeline
|
|
|
|
|
|
|
|
|
|
|
|
|
| 46 |
|
| 47 |
The follow scripts are scheduled to automate the skill monitoring and model tranining processes continually.
|
| 48 |
|
|
|
|
| 23 |
### [Monitoring Platform Link](https://huggingface.co/spaces/Robzy/jobbert_knowledge_extraction)
|
| 24 |
|
| 25 |
<h2>
|
| 26 |
+
<img src="./images/arch_frame.png" alt="Logo" width="30" height="30">
|
| 27 |
Architecture & Frameworks
|
| 28 |
</h2>
|
| 29 |
|
|
|
|
| 35 |
|
| 36 |
|
| 37 |
# High-Level Overview
|
| 38 |
+
<h2>
|
| 39 |
+
<img src="./images/model.png" alt="Logo" width="30" height="30">
|
| 40 |
+
Models
|
| 41 |
+
</h2>
|
| 42 |
|
|
|
|
| 43 |
* **BERT** - finetuned skill extraction model, lightweight.
|
| 44 |
* **LLM** - gpt-4o for skill extraction with multi-shot learning. Computationally expensive.
|
| 45 |
* **Embedding model** - [SentenceTransformers](https://sbert.net/) used to embed skills into vectors.
|
| 46 |
* [**spaCy**](https://spacy.io/models/en#en_core_web_sm) - sentence tokenization model.
|
| 47 |
|
| 48 |
## Pipeline
|
| 49 |
+
<h2>
|
| 50 |
+
<img src="./images/pipeline.png" alt="Logo" width="30" height="30">
|
| 51 |
+
Pipeline
|
| 52 |
+
</h2>
|
| 53 |
|
| 54 |
The follow scripts are scheduled to automate the skill monitoring and model tranining processes continually.
|
| 55 |
|