trohith89 commited on
Commit
0e64d8a
·
verified ·
1 Parent(s): f04a4d6

Delete pages_Pipeline.py

Browse files
Files changed (1) hide show
  1. pages_Pipeline.py +0 -58
pages_Pipeline.py DELETED
@@ -1,58 +0,0 @@
1
- import streamlit as st
2
-
3
- st.markdown(
4
- """
5
- <div style="text-align: center;">
6
- <h1><b>Natural Language Processing Pipeline</b></h1>
7
- </div>
8
- """,
9
- unsafe_allow_html=True
10
- )
11
-
12
- st.image("1726065094370.png",use_container_width = True)
13
-
14
- st.subheader("NLP Pipeline Steps")
15
-
16
- st.write("""
17
- 1. **Text Input and Data Collection**
18
- - **What it is**: Collecting the text data to be analyzed or processed.
19
- - **Sources**: Websites, documents, emails, social media, etc.
20
- - **Why it’s important**: Provides the raw data necessary to build an NLP system.
21
-
22
- 2. **Text Preprocessing**
23
- - **What it is**: Cleaning and preparing the raw text for analysis.
24
- - **Examples**:
25
- - Removing punctuation, numbers, and stopwords.
26
- - Lowercasing text, tokenization, and stemming.
27
- - **Why it’s important**: Ensures that the data is clean and structured for better results.
28
-
29
- 3. **Text Representation**
30
- - **What it is**: Converting text into a numerical format that a machine can understand.
31
- - **Examples**: Techniques like Bag of Words, TF-IDF, or word embeddings (Word2Vec, BERT).
32
- - **Why it’s important**: Machines work with numbers, not raw text, so this step is essential.
33
-
34
- 4. **Feature Selection**
35
- - **What it is**: Selecting the most relevant pieces of data or words for the task.
36
- - **Examples**: Choosing keywords or focusing on specific phrases that matter for classification or prediction.
37
- - **Why it’s important**: Reduces noise in the data and improves the model’s performance.
38
-
39
- 5. **Model Selection and Training**
40
- - **What it is**: Choosing an appropriate machine learning or deep learning model and training it on the data.
41
- - **Examples**: Algorithms like Logistic Regression, SVM, or deep learning models like BERT.
42
- - **Why it’s important**: The model learns patterns in the data to perform tasks like classification or translation.
43
-
44
- 6. **Model Deployment and Inference**
45
- - **What it is**: Deploying the trained model to a real-world environment to make predictions or analyze text.
46
- - **Examples**: A chatbot responding to queries or a search engine ranking results.
47
- - **Why it’s important**: Makes the model usable for solving real-world problems.
48
-
49
- 7. **Evaluation and Optimization**
50
- - **What it is**: Assessing the model’s performance and fine-tuning it for better results.
51
- - **Examples**: Using metrics like accuracy, precision, recall, or F1-score to evaluate the model.
52
- - **Why it’s important**: Ensures the model is reliable and effective in its task.
53
-
54
- 8. **Iteration and Improvements**
55
- - **What it is**: Continuously updating and improving the model based on new data or feedback.
56
- - **Examples**: Retraining the model when new data is available or tweaking features to improve performance.
57
- - **Why it’s important**: Keeps the system relevant and accurate over time.
58
- """)