Update pages/Data Collection.py

pages/Data Collection.py

@@ -273,6 +273,9 @@ if st.session_state.current_page == "main":
                 navigate_to("explore_html")
 
 
+                
+#--------------------------------------------------------- Excel--------------------------------------------------------------------------------
+
 # Page for Explore Excel
 if st.session_state.current_page == "explore_excel":
     # Main Heading
@@ -479,6 +482,10 @@ if st.session_state.current_page == "explore_excel":
     with col2:
         if st.button("⬅️ Back to Previous Page"):
             st.session_state.current_page = "main" 
+            
+
+#--------------------------------------------------------- Images and Video --------------------------------------------------------------------------------
+
 
 elif st.session_state.current_page == "explore_images_video":
     st.markdown("""
@@ -1775,6 +1782,9 @@ elif st.session_state.current_page == "image_transformations":
     cv2.destroyAllWindows()
     """, language="python")
 
+    
+
+#--------------------------------------------------------- Audio--------------------------------------------------------------------------------
 
 
 elif st.session_state.current_page == "explore_audio":
@@ -1788,6 +1798,10 @@ elif st.session_state.current_page == "explore_audio":
         navigate_to("main")
 
 
+#--------------------------------------------------------- text--------------------------------------------------------------------------------
+
+
+
 elif st.session_state.current_page == "explore_text":
     st.markdown("""
         <h3 style="color: #e25822;">Exploring Text</h3>
@@ -1798,15 +1812,160 @@ elif st.session_state.current_page == "explore_text":
     if st.button("Go Back"):
         navigate_to("main")
 
+
+#--------------------------------------------------------- CSV --------------------------------------------------------------------------------
+
+
+
 elif st.session_state.current_page == "explore_csv":
     st.markdown("""
-        <h3 style="color: #e25822;">Exploring CSV</h3>
+        <h3 style="color: #BB3385;">Comma-Separated Values(CSV)</h3>
     """, unsafe_allow_html=True)
+
     st.write("""
-    CSV is a simple text-based format where data fields are separated by commas.
+    - **CSV (Comma-Separated Values)** is a simple file format used to store tabular data.
+    - Each row in a CSV file corresponds to a row of data, with columns separated by delimeter(default Commas).
+    - It is widely used for:
+        - Data storage and exchange between applications.
+        - Importing/exporting data in tools like Excel, databases, and programming languages.
+    - CSV files are lightweight, easy to read, and supported by most data-handling tools.
     """)
-    if st.button("Go Back"):
-        navigate_to("main")
+
+    st.markdown("""
+    <h3 style="color: #5b2c6f;">Reading CSV File</h3>
+    """, unsafe_allow_html=True)
+    
+    st.code("""    
+    # Read the CSV file
+    data = pd.read_csv('path_to_file.csv')
+    print(data.head())  # Displays the first 5 rows
+    """, language="python")
+
+    st.markdown("""
+    <h3 style="color: #5b2c6f;">Exporting CSV File</h3>
+    """, unsafe_allow_html=True)
+    
+    st.code("""
+    import pandas as pd
+    
+    # Sample DataFrame
+    data = pd.DataFrame({
+        'sepal_length': [1.5, 1.4, 1.5],
+        'sepal_width': [2.5, 2.8, 2.5],
+        'petal_length': [2.3, 2.2, 2.3],
+        'petal_width': [1.5, 1.1, 1.5],
+        'species': ['setosa', 'versicolor', 'virginica']
+    })
+    
+    # Export the DataFrame to a CSV file
+    data.to_csv('iris_dataset.csv', index=False)
+    """, language="python")
+
+    # Issues Section
+    st.markdown("""
+    <h3 style="color: #5b2c6f;">Common Issues with CSV Files</h3>
+    """, unsafe_allow_html=True)
+    st.markdown("""
+        <h3 style="color: #BB3385;">1. ParserError</h3>
+    """, unsafe_allow_html=True)
+    
+    st.write("""
+    - This error occurs when there is a mismatch in the number of columns in some rows.
+    - It is commonly caused when a CSV file is manually edited in a text editor, leading to structural inconsistencies.
+    
+    - Use the `on_bad_lines='warn'` or `on_bad_lines='skip'` parameter in `pd.read_csv()` to handle problematic rows.
+    - Clean the CSV file to ensure consistent formatting.
+    """)
+    
+    st.code("""
+    # Reading the CSV file with bad lines handled
+    df = pd.read_csv('sample.csv', on_bad_lines='warn')
+    print(df)
+    """, language="python")
+
+    st.markdown("""
+        <h3 style="color: #BB3385;">1. Encoding Error</h3>
+    """, unsafe_allow_html=True)
+
+    st.write("""
+    - Encoding is the process of converting text from one representation to another.
+    - It specifies how characters are stored and interpreted in files or streams.
+    - Common encoding formats include:
+        - **UTF-8**: The most widely used encoding format, compatible with most languages.
+        - **ISO-8859-1** (Latin-1): Often used for Western European languages.
+        - **ASCII**: Represents basic English characters.
+    """)
+
+    st.write("""
+    - This error occurs when a CSV file is saved with a different encoding format (e.g., `UTF-8`, `ISO-8859-1`).
+    - It often results in unreadable characters or errors while loading the file in Python.
+    
+    - Use the `encoding` parameter in `pd.read_csv()` to specify the correct encoding format.
+    - Common encodings to try:
+        - `encoding='utf-8'`
+        - `encoding='latin1'`
+        - `encoding='iso-8859-1'`
+    """)
+
+    st.code("""
+    df = pd.read_csv('sample.csv', encoding='utf-8')  # Specify the encoding format
+    print(df)
+    """, language="python")
+
+    st.write("""
+    To identify the correct encoding for a CSV file, we can iterate through all possible encodings and try to read the file.
+    This approach helps when the encoding of the file is unknown.
+    """)
+    
+    st.code("""
+    import encodings
+    
+    # Get all possible encodings
+    encoding_list = encodings.aliases.aliases.keys()
+    
+    # Check which encoding works
+    for encoding in encoding_list:
+        try:
+            # Attempt to read the file with the current encoding
+            pd.read_csv(file_path, encoding=encoding)
+            print(f"{encoding} is correct encoding")
+        except UnicodeDecodeError:
+            print(f"{encoding} is not correct encoding")
+    """, language="python")
+
+
+    
+    st.markdown("""
+        <h3 style="color: #BB3385;">1. Out of Memory Issue</h3>
+    """, unsafe_allow_html=True)
+
+    st.write("""
+    - Out of Memory issues occur when the size of the CSV file is too large to fit into the available memory (RAM) of the system.
+    - This typically happens when:
+        - Files contain millions of rows or a large number of columns.
+        - The system's RAM is insufficient to load the entire file at once.
+    
+    - Read the CSV file in smaller chunks using the `chunksize` parameter in `pd.read_csv()`.
+    - Process and save chunks incrementally to avoid memory overload.
+    - Use efficient data types to reduce memory usage.
+    """)
+    st.code("""
+    # Reading a large CSV file in chunks
+    chunk_size = 100000  # Number of rows per chunk
+    chunks = []
+    
+    for chunk in pd.read_csv('large_file.csv', chunksize = chunk_size):
+        chunks.append(chunk)
+    
+    # Combine all chunks into a single DataFrame if needed
+    df = pd.concat(chunks, axis=0)
+    print(df)
+    """, language="python")
+
+
+#--------------------------------------------------------- Json --------------------------------------------------------------------------------
+
+
 
 elif st.session_state.current_page == "explore_json":
     st.markdown("""
@@ -1818,6 +1977,10 @@ elif st.session_state.current_page == "explore_json":
     if st.button("Go Back"):
         navigate_to("main")
 
+
+#--------------------------------------------------------- XML -------------------------------------------------------------------------------
+
+
 elif st.session_state.current_page == "explore_xml":
     st.markdown("""
         <h3 style="color: #e25822;">Exploring XML</h3>
@@ -1828,6 +1991,11 @@ elif st.session_state.current_page == "explore_xml":
     if st.button("Go Back"):
         navigate_to("main")
 
+
+#--------------------------------------------------------- HTML --------------------------------------------------------------------------------
+
+
+
 elif st.session_state.current_page == "explore_html":
     st.markdown("""
         <h3 style="color: #e25822;">Exploring HTML</h3>