recommender-system
/

feature-engineering-guide

English

Guide

Feature Engineering

Model card Files Files and versions

xet

Community

aitek230telu commited on Sep 12, 2024

Commit

a9c5f4b

verified ·

1 Parent(s): 007db89

Update README.md

Browse files

Files changed (1) hide show

README.md +80 -76

README.md CHANGED Viewed

@@ -5,9 +5,13 @@ tags:
 - Guide
 - Feature Engineering
 ---
 # Feature Engineering & Feature Selection
-A comprehensive guide [[pdf]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.pdf) [[markdown]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md) for **Feature Engineering** and **Feature Selection**, with implementations and examples in Python.
 ## Motivation
@@ -27,11 +31,11 @@ Data and feature has the most impact on a ML project and sets the limit of how w
 Download the PDF here:
-- [**PDF Download**](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.pdf)
 Same, but in markdown:
-- [**Mark Down Download**](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md)
 PDF has a much readable format, while Markdown has auto-generated anchor link to navigate from outer source. GitHub sucks at displaying markdown with complex grammar, so I would suggest read the PDF or download the repo and read markdown with [Typora](https://typora.io/).
@@ -74,103 +78,103 @@ Below is a list of methods currently implemented in the repo.
   -    1.1 Variables
   -    1.2 Variable Identification
-       -  Check Data Types   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#12-variable-identification)  [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/1_Demo_Data_Explore.ipynb)
   -    1.3 Univariate Analysis
-       -  Descriptive Analysis   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#13-univariate-analysis)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/1_Demo_Data_Explore.ipynb)
-       -  Discrete Variable Barplot   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#13-univariate-analysis)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/1_Demo_Data_Explore.ipynb)
-       -  Discrete Variable Countplot   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#13-univariate-analysis)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/1_Demo_Data_Explore.ipynb)
-       -  Discrete Variable Boxplot   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#13-univariate-analysis)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/1_Demo_Data_Explore.ipynb)
-       -  Continuous Variable Distplot   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#13-univariate-analysis)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/1_Demo_Data_Explore.ipynb)
   -    1.4 Bi-variate Analysis
-       -  Scatter Plot   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#14-bi-variate-analysis)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/1_Demo_Data_Explore.ipynb)
-       -  Correlation Plot   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#14-bi-variate-analysis)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/1_Demo_Data_Explore.ipynb)
-       -  Heat Map   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#14-bi-variate-analysis)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/1_Demo_Data_Explore.ipynb)
 **2. Feature Cleaning**
   -    2.1 Missing Values
-       -  Missing Value Check   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#214-how-to-handle-missing-data)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.1_Demo_Missing_Data.ipynb)
-       -  Listwise Deletion   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#214-how-to-handle-missing-data)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.1_Demo_Missing_Data.ipynb)
-       -  Mean/Median/Mode Imputation   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#214-how-to-handle-missing-data)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.1_Demo_Missing_Data.ipynb)
-       -  End of distribution Imputation   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#214-how-to-handle-missing-data)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.1_Demo_Missing_Data.ipynb)
-       -  Random Imputation   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#214-how-to-handle-missing-data)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.1_Demo_Missing_Data.ipynb)
-       -  Arbitrary Value Imputation   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#214-how-to-handle-missing-data)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.1_Demo_Missing_Data.ipynb)
-       -  Add a variable to denote NA   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#214-how-to-handle-missing-data)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.1_Demo_Missing_Data.ipynb)
   -    2.2 Outliers
-       -  Detect by Arbitrary Boundary   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#222-outlier-detection)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.2_Demo_Outlier.ipynb)
-       -  Detect by Mean & Standard Deviation   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#222-outlier-detection)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.2_Demo_Outlier.ipynb)
-       -  Detect by IQR    [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#222-outlier-detection)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.2_Demo_Outlier.ipynb)
-       -  Detect by MAD      [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#222-outlier-detection)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.2_Demo_Outlier.ipynb)
-       -  Mean/Median/Mode Imputation   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#223-how-to-handle-outliers)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.2_Demo_Outlier.ipynb)
-       -  Discretization   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#223-how-to-handle-outliers)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.2_Demo_Discretisation.ipynb)
-       -  Imputation with Arbitrary Value   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#223-how-to-handle-outliers)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.2_Demo_Outlier.ipynb)
-       -  Windsorization   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#223-how-to-handle-outliers)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.2_Demo_Outlier.ipynb)
-       -  Discard Outliers   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#223-how-to-handle-outliers)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.2_Demo_Outlier.ipynb)
   -    2.3 Rare Values
-       -  Mode Imputation     [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#23-rare-values)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.3_Demo_Rare_Values.ipynb)
-       -  Grouping into One New Category   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#23-rare-values)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.3_Demo_Rare_Values.ipynb)
   -    2.4 High Cardinality
-       -  Grouping Labels with Business Understanding    [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#24-high-cardinality)
-       -  Grouping Labels with Rare Occurrence into One Category   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#24-high-cardinality)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.3_Demo_Rare_Values.ipynb)
-       -  Grouping Labels with Decision Tree   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#24-high-cardinality)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.2_Demo_Discretisation.ipynb)
 **3. Feature Engineering**
   -    3.1 Feature Scaling
-       -  Normalization - Standardization    [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#31-feature-scaling)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.1_Demo_Feature_Scaling.ipynb)
-       -  Min-Max Scaling   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#31-feature-scaling)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.1_Demo_Feature_Scaling.ipynb)
-       -  Robust Scaling   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#31-feature-scaling)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.1_Demo_Feature_Scaling.ipynb)
   -    3.2 Discretize
-       -  Equal Width Binning   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#32-discretize)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.2_Demo_Discretisation.ipynb)
-       -  Equal Frequency Binning   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#32-discretize)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.2_Demo_Discretisation.ipynb)
-       -  K-means Binning      [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#32-discretize)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.2_Demo_Discretisation.ipynb)
-       -  Discretization by Decision Trees   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#32-discretize)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.2_Demo_Discretisation.ipynb)
-       -  ChiMerge   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#32-discretize)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.2_Demo_Discretisation.ipynb)
   -    3.3 Feature Encoding
-       -  One-hot Encoding   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#33-feature-encoding)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.3_Demo_Feature_Encoding.ipynb)
-       -  Ordinal-Encoding   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#33-feature-encoding)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.3_Demo_Feature_Encoding.ipynb)
-       -  Count/frequency Encoding    [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#33-feature-encoding)
-       -  Mean Encoding   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#33-feature-encoding)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.3_Demo_Feature_Encoding.ipynb)
-       -  WOE Encoding   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#33-feature-encoding)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.3_Demo_Feature_Encoding.ipynb)
-       -  Target Encoding   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#33-feature-encoding)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.3_Demo_Feature_Encoding.ipynb)
   -    3.4 Feature Transformation
-       -  Logarithmic Transformation   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#34-feature-transformation)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.4_Demo_Feature_Transformation.ipynb)
-       -  Reciprocal Transformation   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#34-feature-transformation)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.4_Demo_Feature_Transformation.ipynb)
-       -  Square Root Transformation   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#34-feature-transformation)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.4_Demo_Feature_Transformation.ipynb)
-       -  Exponential Transformation   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#34-feature-transformation)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.4_Demo_Feature_Transformation.ipynb)
-       -  Box-cox Transformation   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#34-feature-transformation)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.4_Demo_Feature_Transformation.ipynb)
-       -  Quantile Transformation   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#34-feature-transformation)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.4_Demo_Feature_Transformation.ipynb)
   -    3.5 Feature Generation
-       -  Missing Data Derived   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#35-feature-generation)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/2.1_Demo_Missing_Data.ipynb)
-       -  Simple Stats   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#35-feature-generation)
-       -  Crossing   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#35-feature-generation)
-       -  Ratio & Proportion   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#35-feature-generation)
-       -  Cross Product   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#35-feature-generation)
-       -  Polynomial   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#35-feature-generation)  [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.5_Demo_Feature_Generation.ipynb)
-       -  Feature Learning by Tree   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#35-feature-generation)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/3.5_Demo_Feature_Generation.ipynb)
-       -  Feature Learning by Deep Network   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#35-feature-generation)
 **4. Feature Selection**
   -    4.1 Filter Method
-       -  Variance   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#41-filter-method)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/4.1_Demo_Feature_Selection_Filter.ipynb)
-       -  Correlation   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#41-filter-method)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/4.1_Demo_Feature_Selection_Filter.ipynb)
-       -  Chi-Square   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#41-filter-method)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/4.1_Demo_Feature_Selection_Filter.ipynb)
-       -  Mutual Information Filter   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#41-filter-method)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/4.1_Demo_Feature_Selection_Filter.ipynb)
-       -  Information Value (IV)   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#41-filter-method)
   -    4.2 Wrapper Method
-       -  Forward Selection   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#42-wrapper-method)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/4.2_Demo_Feature_Selection_Wrapper.ipynb)
-       -  Backward Elimination   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#42-wrapper-method)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/4.2_Demo_Feature_Selection_Wrapper.ipynb)
-       -  Exhaustive Feature Selection   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#42-wrapper-method)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/4.2_Demo_Feature_Selection_Wrapper.ipynb)
-       -  Genetic Algorithm   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#42-wrapper-method)
   -    4.3 Embedded Method
-       -  Lasso (L1)   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#43-embedded-method)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/4.3_Demo_Feature_Selection_Embedded.ipynb)
-       -  Random Forest Importance   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#43-embedded-method)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/4.3_Demo_Feature_Selection_Embedded.ipynb)
-       -  Gradient Boosted Trees Importance   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#43-embedded-method)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/4.3_Demo_Feature_Selection_Embedded.ipynb)
   -    4.4 Feature Shuffling
-       -  Random Shuffling   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#44-feature-shuffling)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/4.4_Demo_Feature_Selection_Feature_Shuffling.ipynb)
   -    4.5 Hybrid Method
-       -  Recursive Feature Selection    [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#451-recursive-feature-elimination)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/4.5_Demo_Feature_Selection_Hybrid_method.ipynb)
-       -  Recursive Feature Addition   [[guide]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#452-recursive-feature-addition)   [[demo]](https://github.com/ashishpatel26/Amazing-Feature-Engineering/blob/master/4.5_Demo_Feature_Selection_Hybrid_method.ipynb)

 - Guide
 - Feature Engineering
 ---
+# Disclaimer
+This guidence is copying from github repository [ashipatel26/Amazing-Feature-Engineering](https://github.com/ashishpatel26/Amazing-Feature-Engineering).
+In this HF repository we using it for our student, because there are dissertation is correlated with feature engineering on recommender system.
 # Feature Engineering & Feature Selection
+A comprehensive guide [[pdf]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.pdf) [[markdown]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md) for **Feature Engineering** and **Feature Selection**, with implementations and examples in Python.
 ## Motivation
 Download the PDF here:
+- [**PDF Download**](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.pdf)
 Same, but in markdown:
+- [**Mark Down Download**](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md)
 PDF has a much readable format, while Markdown has auto-generated anchor link to navigate from outer source. GitHub sucks at displaying markdown with complex grammar, so I would suggest read the PDF or download the repo and read markdown with [Typora](https://typora.io/).
   -    1.1 Variables
   -    1.2 Variable Identification
+       -  Check Data Types   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#12-variable-identification)  [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/1_Demo_Data_Explore.ipynb)
   -    1.3 Univariate Analysis
+       -  Descriptive Analysis   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#13-univariate-analysis)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/1_Demo_Data_Explore.ipynb)
+       -  Discrete Variable Barplot   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#13-univariate-analysis)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/1_Demo_Data_Explore.ipynb)
+       -  Discrete Variable Countplot   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#13-univariate-analysis)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/1_Demo_Data_Explore.ipynb)
+       -  Discrete Variable Boxplot   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#13-univariate-analysis)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/1_Demo_Data_Explore.ipynb)
+       -  Continuous Variable Distplot   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#13-univariate-analysis)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/1_Demo_Data_Explore.ipynb)
   -    1.4 Bi-variate Analysis
+       -  Scatter Plot   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#14-bi-variate-analysis)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/1_Demo_Data_Explore.ipynb)
+       -  Correlation Plot   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#14-bi-variate-analysis)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/1_Demo_Data_Explore.ipynb)
+       -  Heat Map   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#14-bi-variate-analysis)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/1_Demo_Data_Explore.ipynb)
 **2. Feature Cleaning**
   -    2.1 Missing Values
+       -  Missing Value Check   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#214-how-to-handle-missing-data)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.1_Demo_Missing_Data.ipynb)
+       -  Listwise Deletion   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#214-how-to-handle-missing-data)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.1_Demo_Missing_Data.ipynb)
+       -  Mean/Median/Mode Imputation   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#214-how-to-handle-missing-data)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.1_Demo_Missing_Data.ipynb)
+       -  End of distribution Imputation   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#214-how-to-handle-missing-data)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.1_Demo_Missing_Data.ipynb)
+       -  Random Imputation   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#214-how-to-handle-missing-data)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.1_Demo_Missing_Data.ipynb)
+       -  Arbitrary Value Imputation   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#214-how-to-handle-missing-data)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.1_Demo_Missing_Data.ipynb)
+       -  Add a variable to denote NA   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#214-how-to-handle-missing-data)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.1_Demo_Missing_Data.ipynb)
   -    2.2 Outliers
+       -  Detect by Arbitrary Boundary   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#222-outlier-detection)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.2_Demo_Outlier.ipynb)
+       -  Detect by Mean & Standard Deviation   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#222-outlier-detection)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.2_Demo_Outlier.ipynb)
+       -  Detect by IQR    [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#222-outlier-detection)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.2_Demo_Outlier.ipynb)
+       -  Detect by MAD      [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#222-outlier-detection)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.2_Demo_Outlier.ipynb)
+       -  Mean/Median/Mode Imputation   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#223-how-to-handle-outliers)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.2_Demo_Outlier.ipynb)
+       -  Discretization   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#223-how-to-handle-outliers)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.2_Demo_Discretisation.ipynb)
+       -  Imputation with Arbitrary Value   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#223-how-to-handle-outliers)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.2_Demo_Outlier.ipynb)
+       -  Windsorization   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#223-how-to-handle-outliers)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.2_Demo_Outlier.ipynb)
+       -  Discard Outliers   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#223-how-to-handle-outliers)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.2_Demo_Outlier.ipynb)
   -    2.3 Rare Values
+       -  Mode Imputation     [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#23-rare-values)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.3_Demo_Rare_Values.ipynb)
+       -  Grouping into One New Category   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#23-rare-values)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.3_Demo_Rare_Values.ipynb)
   -    2.4 High Cardinality
+       -  Grouping Labels with Business Understanding    [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#24-high-cardinality)
+       -  Grouping Labels with Rare Occurrence into One Category   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#24-high-cardinality)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.3_Demo_Rare_Values.ipynb)
+       -  Grouping Labels with Decision Tree   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#24-high-cardinality)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.2_Demo_Discretisation.ipynb)
 **3. Feature Engineering**
   -    3.1 Feature Scaling
+       -  Normalization - Standardization    [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#31-feature-scaling)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.1_Demo_Feature_Scaling.ipynb)
+       -  Min-Max Scaling   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#31-feature-scaling)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.1_Demo_Feature_Scaling.ipynb)
+       -  Robust Scaling   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#31-feature-scaling)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.1_Demo_Feature_Scaling.ipynb)
   -    3.2 Discretize
+       -  Equal Width Binning   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#32-discretize)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.2_Demo_Discretisation.ipynb)
+       -  Equal Frequency Binning   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#32-discretize)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.2_Demo_Discretisation.ipynb)
+       -  K-means Binning      [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#32-discretize)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.2_Demo_Discretisation.ipynb)
+       -  Discretization by Decision Trees   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#32-discretize)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.2_Demo_Discretisation.ipynb)
+       -  ChiMerge   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#32-discretize)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.2_Demo_Discretisation.ipynb)
   -    3.3 Feature Encoding
+       -  One-hot Encoding   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#33-feature-encoding)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.3_Demo_Feature_Encoding.ipynb)
+       -  Ordinal-Encoding   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#33-feature-encoding)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.3_Demo_Feature_Encoding.ipynb)
+       -  Count/frequency Encoding    [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#33-feature-encoding)
+       -  Mean Encoding   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#33-feature-encoding)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.3_Demo_Feature_Encoding.ipynb)
+       -  WOE Encoding   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#33-feature-encoding)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.3_Demo_Feature_Encoding.ipynb)
+       -  Target Encoding   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#33-feature-encoding)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.3_Demo_Feature_Encoding.ipynb)
   -    3.4 Feature Transformation
+       -  Logarithmic Transformation   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#34-feature-transformation)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.4_Demo_Feature_Transformation.ipynb)
+       -  Reciprocal Transformation   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#34-feature-transformation)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.4_Demo_Feature_Transformation.ipynb)
+       -  Square Root Transformation   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#34-feature-transformation)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.4_Demo_Feature_Transformation.ipynb)
+       -  Exponential Transformation   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#34-feature-transformation)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.4_Demo_Feature_Transformation.ipynb)
+       -  Box-cox Transformation   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#34-feature-transformation)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.4_Demo_Feature_Transformation.ipynb)
+       -  Quantile Transformation   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#34-feature-transformation)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.4_Demo_Feature_Transformation.ipynb)
   -    3.5 Feature Generation
+       -  Missing Data Derived   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#35-feature-generation)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/2.1_Demo_Missing_Data.ipynb)
+       -  Simple Stats   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#35-feature-generation)
+       -  Crossing   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#35-feature-generation)
+       -  Ratio & Proportion   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#35-feature-generation)
+       -  Cross Product   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#35-feature-generation)
+       -  Polynomial   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#35-feature-generation)  [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.5_Demo_Feature_Generation.ipynb)
+       -  Feature Learning by Tree   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#35-feature-generation)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/3.5_Demo_Feature_Generation.ipynb)
+       -  Feature Learning by Deep Network   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#35-feature-generation)
 **4. Feature Selection**
   -    4.1 Filter Method
+       -  Variance   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#41-filter-method)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/4.1_Demo_Feature_Selection_Filter.ipynb)
+       -  Correlation   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#41-filter-method)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/4.1_Demo_Feature_Selection_Filter.ipynb)
+       -  Chi-Square   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#41-filter-method)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/4.1_Demo_Feature_Selection_Filter.ipynb)
+       -  Mutual Information Filter   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#41-filter-method)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/4.1_Demo_Feature_Selection_Filter.ipynb)
+       -  Information Value (IV)   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#41-filter-method)
   -    4.2 Wrapper Method
+       -  Forward Selection   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#42-wrapper-method)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/4.2_Demo_Feature_Selection_Wrapper.ipynb)
+       -  Backward Elimination   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#42-wrapper-method)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/4.2_Demo_Feature_Selection_Wrapper.ipynb)
+       -  Exhaustive Feature Selection   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#42-wrapper-method)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/4.2_Demo_Feature_Selection_Wrapper.ipynb)
+       -  Genetic Algorithm   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#42-wrapper-method)
   -    4.3 Embedded Method
+       -  Lasso (L1)   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#43-embedded-method)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/4.3_Demo_Feature_Selection_Embedded.ipynb)
+       -  Random Forest Importance   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#43-embedded-method)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/4.3_Demo_Feature_Selection_Embedded.ipynb)
+       -  Gradient Boosted Trees Importance   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#43-embedded-method)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/4.3_Demo_Feature_Selection_Embedded.ipynb)
   -    4.4 Feature Shuffling
+       -  Random Shuffling   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#44-feature-shuffling)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/4.4_Demo_Feature_Selection_Feature_Shuffling.ipynb)
   -    4.5 Hybrid Method
+       -  Recursive Feature Selection    [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#451-recursive-feature-elimination)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/4.5_Demo_Feature_Selection_Hybrid_method.ipynb)
+       -  Recursive Feature Addition   [[guide]](https://huggingface.co/recommender-system/feature-engineering-guide/blob/main/A%20Short%20Guide%20for%20Feature%20Engineering%20and%20Feature%20Selection.md#452-recursive-feature-addition)   [[demo]](https://huggingface.co/recommender-system/feature-engineering-guide/tree/main/4.5_Demo_Feature_Selection_Hybrid_method.ipynb)