Using principal component analysis (PCA) for feature selection in regression


Calculate AUC of a logistic regression model


Difference between two separate multiple regression analyses and one combined using dummy variables


Probabilistic (Bayesian) vs Optimisation (Frequentist) methods in Machine Learning


Relatively normalizing values for collaborative filtering


Interpretation of main effect when interaction term is significant (ex. lme)


Do we need a global test before post hoc tests?


How can I determine local minima from a Kernel Density Estimation?


Why on average does each bootstrap sample contain roughly two thirds of observations?


exact percentage change for the estimated COOP effect


F test for regressions with a small N with robust standard errors


Practical thoughts on explanatory vs predictive modeling


Geometric mean of uniform variables


How to get the prediction values for two response variables from random forest?


purpose p value with CI in non-inferiority trials


How to find percentiles of a Normal distribution?


What's wrong with XKCD's Frequentists vs. Bayesians comic?


Why does t statistic increase with the sample size?


What does "unbiasedness" mean?


Sum of squared errors


Standard deviation of binned observations


Markov chain getting stuck due to insufficient data samples


How to read quantiles from R2WinBUGS?


How to create a ratio from different measures?


When is it ok to remove the intercept in lm()?


"Normalizing" variables for SVD / PCA


What is the difference between "data mining" and "data analytics"?


What is the current 'standard' for modern statistical computing hardware?


What are good references containing arguments against null hypothesis significance testing?


How can I group numerical data into naturally forming "brackets"? (e.g. income)


Regression modelling with unequal variance


What is a good algorithm for estimating the median of a huge read-once data set?


T-test vs. one-way ANOVA


Derive househould weights from a uniformly distributed person sample


Is it possible to determine the set of variables contributing the most to first two principal components?


How do I analyse principal component scores?


Find relations without confounding variables?


Why do PCA scores differ in sign?


Multivariate Hypergeometric Distribution with "or more" Successes


Help interpreting R linear model fit


Calculation of AUC value from ROC Curve


How should I transform non-negative data including zeros?


Standardized beta weights for a multilevel regression


Cross tabulation of two categorical variables: recommended techniques


How to best display graphically type II (beta) error, power and sample size?


What correlation makes a matrix singular and what are implications of singularity or near-singularity?


Probability of two people meeting when the arrival intervals and wait times are different


How to test for equality of means for proportions? And two-sided or one-sided?


How to compute probabilities of normally distributed variables?


Multivariate normal distribution?


What is your favorite, easy to use statistical analysis website or software package?


Comparing two logit or probit curves using a single parameter


Social network datasets


Simplest example of uncorrelated but not independent X and Y?


What is the intuition behind conditional Gaussian distributions?


standard deviation in unbiased problem


What are the values p, d, q, in ARIMA?


Is an online chi square calculator available for larger tables?


A reliable measure of series similarity - correlation just doesn't cut it for me


R vs Python for Data Analysis


PCA analysis with centered variables


Why are the number of false positives independent of sample size, if we use p-values to compare two independent datasets?


Should I use log transformation for my linear regression?


Structural break test on an arma model any statistical software packages


Representing a distance matrix in the plane


Difference between 'link function' and 'canonical link function' for GLM


Difference between FA and PCA


What analysis (in SPSS) should I use for a repeated measures design with dichotomous outcome variable?


Describing standard deviation


How to show that the $E[x_i] = \bar{X}$


How to deal with missing values for PCA?


create dataset for particular correlation for two variable


Are these events independent?


How to interpret results from a nonparametric Wilcoxon test


Validation techniques for hierarchical model


Why is the Fisher Information matrix positive semidefinite?


Under what conditions should one use multilevel/hierarchical analysis?


"matrix is not positive definite" - even when highly correlated variables are removed


Difference between standard error and standard deviation


Is Amazon's "average rating" misleading?


Joint test for absolute value of a mean


ANOVA assumption normality/normal distribution of residuals


What is $P(X_1>X_2 , X_1>X_3,... , X_1>X_n)$?


Weibull analysis


What does it mean for two variables to be uncorrelated? How is it possible for two variables to be strongly related but still uncorrelated


Intuitive examples of importance sampling


$\chi^2$ goodness of fit - how to compute expected counts when $\exists$ unknown parameters


How to compare two groups when one only has one data point?


Find the distribution of w


"Accept null hypothesis" or "fail to reject the null hypothesis"?


test if two normally distributed random variables are equal


Book recommendations for beginners about probability distributions


Good books for Duration Analysis


How to estimate the confidence interval using sample average and sample size ONLY?


Interpretation of Kolmogorov-Smirnov Generated Distributions


What is the best way to convert learning to rank to pairwise preference learning?


How to plot ROC curves in multiclass classification?


wilcox.test usage in R


R-squared for linear mixed effects model


Why are p-values uniformly distributed under the null hypothesis?


Online logistic regression?


Logistic Regression in R (Odds Ratio)


How to interpret log of independent variable in Poisson regression?


What is the difference between N and N-1 in calculating population variance?


Significant predictor loses significance when second non-significant predictor is entered (log regression)


Difference between Cohen's d and Hedges' g for effect size metrics


Boxplot interpretation: is it correct that a boxplot is missing a whisker?


Properties of moment-generating functions


How to compare 2 regression slopes with R?


What test should I use with shannon diversity index values?


Probability of observing value EQUAL to +2 SD in a standard normal dist with parameters N(0,1)


Calculating required sample size, precision of variance estimate?


Sum of independent non-normal random variables


If A and B are correlated with C, why are A and B not necessarily correlated?


How do you calculate the Ordinary Least Squares estimated coefficients in a Multiple Regression Model?


Probablity of getting sequence of K equal results while tossing coin N times


How can I help ensure testing data does not leak into training data?


A non-parametric repeated-measures multi-way Anova in R?


non significance with one-way ANOVA, but significance with multiple comparisons


Bias in lagged dependent variable


Random Forests and Feature selection


How to perform a test using R to see if data follows normal distribution


Kolmogorov-Smirnov test for large sample


What are the chances my wife has lupus?


Imputing values using additional data w/o knowing underlying structure


Interpretting LASSO variable trace plots


Are these values really different, given their confidence intervals?


Calculating the 95th percentile: Comparing normal distribution, R Quantile, and Excel approaches


More examples of inconsistent, but unbiased data and vice versa?


In testing random numbers, what other tests should I use to complement the Kolmogorov-Smirnov?


Negative AIC linear regression model


Getting the inflection point(s) from a density plot


In R, how do I fit a student-t distribution to a set of empirical data?


normalising constant on exponential of exponential


Distribution from which to sample integers evenly between 1 and 1000?


what mean a p-value above 0.05 doing an ANOVA?


Factor analysis and regression


How does Support vector machine predict the classes for the test points?


Forcing a set of numbers to a gaussian bell-curve


Central Limit Theorem


Forecast Daily Data with Multiple Seasonality


What is the probability of tossing k heads in n trials of a fair coin?


Transform higher order Markov Chain to first order


binomial GLM output hugely affected by a factor level with all zeros


Approximation of explained variance


Clustering using different distance measures


Understanding the effect of each parameter in a Monte Carlo Simulation


Measures of association, Concordant and Discordant


Excluding the components and only including the interaction term in a logistic regression?


Estimates of variance from an iid sample


Distribution of a vector divided by its sum


Derive Variance of regression coefficient in simple linear regression


How to calculate mean and standard deviation in R given confidence interval and a normal or gamma distribution?


Why we solve the dual problem in SVM?


How to calculate a maximum standard deviation?


How do I write a mathematical equation for ARIMA (2,1,0) x (0,2,2) period 12


Covariance matrix proposal distribution


What are the implications of a regression model failing the JB normality test?


pLSA - Probabilistic Latent Semantic Analysis, how to choose topic number?


Rolling analysis with out-of sample


Evaluate definite interval of normal distribution


What is the error on measuring the phase of a sine wave?


Can one compute confidence intervals for a census with high nonresponse rates?


Kruskal-Wallis test for factorial design


PCA on non-centered data


Probability distribution for different probabilities


What distribution does my data follow?


Confused by MATLAB's implementation of ridge


Example of distribution where large sample size is necessary for central limit theorem


"optimum" tree from random forests


Finding distribution function


Good econometrics textbooks?


Reproduce a confidence interval of linear regression in Excel


How to correlate ordinal and nominal variables in SPSS?


Log and natural log


Does it make sense to cut a continuous variable to intervals?


regression with multiple response variable in R


how Neural Network works on image recognition


Group differences on a five point Likert item


Is $R^2$ useful or dangerous?


How to include number of not-yet-decayed radioactive atoms in MLE?


Good book on statistics


We said the data is normally distributed, based on the raw data or residual?


Algorithms for automatic model selection


Why is the p-value written with a supremum?


Function of an efficient estimator?


How to compare performance of probability estimating model


APA-style forest plot using metafor


Change in regression coeficient using multiple regression


Probability distribution and uniform distribution in a sphere


No degrees of freedom in LR rest of multinomial logistic regression


Kriging on log transformed rainfall data


Normal Quantile Quantile Plot Normalization


MC Integration Interval Probability


How to properly handle Infs in a statistical function?


When is logistic regression solved in closed form?


Time taken to hit a pattern of heads and tails in a series of coin-tosses


Diagnostics for logistic regression?


Dimensionality reduction (SVD or PCA) on a large, sparse matrix


Determining a correction factor and applying it to a second set of numbers


Describing the association between dependent and independent variables


What's the accuracy of data obtained through a random sample?


Proper back-transformation of lognormal standard deviation to find confidence intervals around a mean


Estimating the absolute decline of rates


Extremely unequal sample size in logistic regression


Comparison of two error distributions to determine "goodness of fit"


Finding the probability of getting a complete set from N classes of objects in M draws


Intuition For Overlapping Confidence Intervals and Statistical Significance


How to do a pretty scatter plot in R?


Advantages of ROC curves


Good methods for density plots of non-negative variables in R?


When (and why) to take the log of a distribution (of numbers)?


Why does standard error not involve population size?


80% of missing data in a single variable


One-Tailed Fisher's Exact Test


How do I interpret this fitted vs residuals plot


First order statistics (min) of n non-identical but independent normal variates


Why are the eigenvalues of a covariance matrix corresponding to the data's variance?


Neyman-Pearson lemma: critical region and hypothesis testing


What are the methods for multivariate outlier detection?


How to calculate Weighted mean using SPSS


What is the difference between a parametric test and non-parametric tests?


Rule of thumb for number of bootstrap samples


Determine different clusters of 1d data from database


Explain Kernel density chart


Where to find a good beginner's R Primer?


Should I use variance or standard deviation as weights to combine independent measurements?


Where to find a large text corpus?


Continuous dependent variable with ordinal independent variable


What, precisely, is a confidence interval?


chisq.test in R doesn't produce same answer as by-hand


When are two normally distributed random variables jointly bivariate normal?


How are the standard errors of coefficients calculated in a regression?


How to Interpret a negative log linear regression coefficient?


Standard errors for multiple regression coefficients?


Moment generating function of the inner product of two gaussian random vectors


Estimate PDF from only positive data


Does MLE always mean we know the underlying PDF of our data, and does EM mean we don't?


How to perform unsupervised Random Forest classification using Breiman's code?


How to test for significant difference between 2 binary variables in one sample


Books for self-studying time series analysis?


How does dsgh work in R?


Creating a Quality Index


How do I rank variables collected by a Likert scale questionnaire?


Assessing approximate distribution of data based on a histogram


PMF of two Poisson RV subtracted from each other


Regression model for proportion or count when counts of outcome and total events are often zero


Interpreting main effect and interaction


GLM Distribution of Residuals


subtraction of two multivariate normal distribution


Why should the feature be standardized before feeding to the neural network algorithm


No linear effects but a quadratic effect


Analyzing reflected and transformed variables II


Why do regression coefficients change when excluding variables?


JAGS burn-in phase takes ZERO time?


Why does increasing the number of features reduce performance?


How to determine whether a categorical variable is statistically significant?


Effect Size/Mean Squared Error from Linear Mixed-Model in R


Why are 5+ expected frequencies needed in Pearson's chi-square


Difference between Time series and repeated measures analysis?


Comparing two classifier accuracy results for statistical significance with t-test


Link between moment-generating function and characteristic function


Is it required for panel data to use dummy variables?


How to perform a regression model with a mix of binary, nominal, ordinal, and continuous predictors?


Interpretation of log transformed predictors in logistic regression


Is there any use for the quantity $\int f(x)^2 dx$ in statistics or information theory?


Interpretation of Linear SVM Coefficients


Should covariates that are not statistically significant be 'kept in' when creating a model?


Behavior of a sum of kernel functions


In GLIM, Is the link function of mean linear in explanatory variables?


Correction term in variance of mixture


Wilcoxon two-sample test approximated by z-statistic


Detecting outstanding events


How to compare ratings of airlines on a Likert scale when different participants have rated different airlines?


Calculating percentile of normal distribution


Is the W statistic outputted by wilcox.test() in R the same as the U statistic?


How to generate two correlated categorical variables?


Help with pretest-postest data analysis


Confusion regarding a probability problem


having trouble applying hidden markov models to my game


Can non-normal data be used for factor analysis?


Text Books on Text Mining in R


How should one interpret the comparison of means from different sample sizes?


Power analysis of a secondary data set with a multi-level model


Determining If Transformation of Variables X Are Needed


Non-parametric alternative for 2-way ANOVA


Sequence mining in univariate discrete data using R


How can dummy variables are able to add in Stata?


Centering vs. Standarizing which one is better?


Why is coefficient of determination used to assess fit of a least squares line?


Why continue to teach and use hypothesis testing?


A constant as an admissible estimator


Why does the correlation coefficient between X and X-Y random variables tend to be 0.7


How to interpret regression coefficients for a variable with takes positive and negative values?


How to calculate the difference of two slopes?


How to use gain and splitinfo for continuous attributes?


Tests significative with parametric calculations and non-significative with non-parametric ones!


Appropriate post-hoc test after a mixed design anova in R


How to use SVD for dimensionality reduction


impact on hypothesis if t-stat is equal to t-critical value for one-tail two-sample t-test?


Is interaction possible between two continuous variables?


Are there concerns with doing a generalized additive model with a smoothing term of multiple variables?


MANOVA vs. Repeated Measure ANOVA


Monte Carlo approach to compute prediction interval for GLM (Poisson & Neg Bin) with R


random number generation and probability problems


Quantitative method to determine necessary and sufficient causes


What's the difference between probability and statistics?


Interpreting a confidence interval


Difference between one-tailed and two-tailed testing?


Confidence Interval for a Fraction?


F and t statistics in a regression


Graphing data large and small


How is Poisson distribution different to normal distribution?


Why are MA(q) time series models called "moving averages"?


Find linear subsets in a 2D point (xy) data


What is the best introductory Bayesian statistics textbook?


What hypothesis for A is better than B?


Optimising for Precision-Recall curves under class imbalance


What is this kind of graph called? (2D grid with a color-coded scale for a 3rd variable)


Is there a term for $P(A\cap B)/[P(A)P(B)]$?


Can a dichotomous variable (yes/no) be merged with a Likert measure (1,2,3,4) using z scores?


Does the size of the reference sample matter in logistic regression?


Odds Ratio Coefficient


If MGF exists, does it imply that all $E(X^n)$ exist?


Why is it that it is self-defeating to use the posterior mode as the bayes estimator in this case?


ANCOVA and its disturbing assumptions


Overall rank from multiple ranked lists


When I add higher order terms in a regression, do I need to add the main effect?


Finding an acceptable upper limit on a random generator with an unknown distribution


Solved Assumptions of Linear Regression


Interpreting ANOVA results


What is a good book on experimental design and data analysis relevant to industrial bakery applications?


Relationship Between Correlation and Multicollinearity


Functions of Independent Random Variables


Calculating concordance using either Pearson or Spearman (rank) correlations


How to simulate artificial data for logistic regression?


Supervised learning with "rare" events, when rarity is due to the large number of counter-factual events


Deriving ordered statistics minimum cdf


How to determine whether a set of data are qualitative or quantitative?


Hosmer-Lemeshow vs AIC for logistic regression


k-means and different metrics


Repeated measure problem


Expected value (Chi-Squared)


What is covariance in plain language?


Poisson regression instead of log transformation of a continuous outcome variable?


reshape data from wide to long in R


Nonparametric test when variances are unequal


How to fit data that looks like a gaussian?


Incremental or online or single pass or data stream clustering refers to the same thing?


Computation of new standard deviation using old standard deviation after change in dataset


What are examples where a "naive bootstrap" fails?


Determining an optimum and distribution range for a given species abundance vs an environmental gradient data


How to interpret regression coefficients when response was transformed by the 4th root?


Testing equality of variances without the data, just from the variances and the mean


Why does the Lasso provide Variable Selection?


How do I interpret the results of a Breusch–Pagan test?


Computing and plotting a correlogram


Logit versus Probit


Ordinal item on Likert scale as dependent variable in regression


Do I need to use t-test?


Correlation of categorical and interval variables


What does this test mean?


Strategy for deciding appropriate model for count data


Statistical test for a random die roll?


Meaning of Likelihood in layman's terms


Comparison between multi-level modelling and generalized estimating equation


Is Marliyn vos Savant correct about the 2/3 odds in her version of the Monty Hall problem?


How to specify the random term in lme, lmer and aov?


Goodness of fit test for a mixture in R


Stepwise regression in R – Critical p-value


Correlation between discrete and continuous variables


Prerequisites for AIC model comparison


What is a lift chart?


Dimensionality reduction using self-organizing map


Calculate Standard deviation from mean and confidence interval (95%) in R


Are confidence intervals always symmetrical around the point estimate?


How can I statistically compare two time-series?


Two negative beta's in a curvilinear regression when mean centered or using standardized values


Is the R language reliable for the field of economics?


Converting standard error to standard deviation?


Test to see what population an observation came from


OLS Regression for binary outcome


How to perform step() when n < p in R?


Mean centering and setting standard deviation to 1 in data


What is a good internet based source of information on Hierarchical Modeling?


What are some quick initial tests to check the quality of a new dataset?


trouble using highfrequency package in R


Chi-squared goodness-of-fit statistic if expected frequency is zero


What is Deviance? (specifically in CART/rpart)


the relationship between hypothesis test and confidence interval?


Understanding signficant interaction with non-significant main effects


Managing error with GPS routes (theoretical framework?)


Normality of residuals vs sample data; what about t-tests?


Generating even-sized clusters in scikit-learn


Normal curve probability mean


R gives weird dispersion value


Recommend an enjoyable / introductory book on Statistics


Generalized linear mixed model in R


Moving-average model error terms


Problem with calculating $R^2$


Interpreting negative coordinates and origin in 2D correspondence analysis plot


Wrong results using ANOVA with repeated measures


Confidence interval for the height of a histogram bar


Is the Mundlak fixed effects procedure applicable for logistic regression with dummies?


In simple linear regression, why the covariance between y bar and beta1 hat is zero?


How to interpret the divergence of Fisher information expectation


How to determine significant subgroups of data inputs?


What kind of test should I use?


Covariate vs. factors


Central Limit Theorem, what does it really say?


Algorithm for rating books: Relative perception


Analysis to perform


Covariance matrix of least squares estimator $\hat{\beta}$


The Two Cultures: statistics vs. machine learning?


sum of noncentral Chi-square random variables


Linear model overfit due to too many covariates?


Convergence of a sequence of random variables


A simple optimization problem


Dynamic recommender systems


What do parallel lines in a fitted values vs. residual plot mean? How should I transform my data?


Confidence interval about the difference between false positive and false negative proportions


Consistency of OLS


Conditional Expectation / Estimator Confusion


multicollinearity in OLS regression


How to cluster a distance matrix?


How can I use logistic regression with categorical variables?


Collectively evaluate a number of normal distributions


Which equal correlations of three random variables are possible?


My distribution is normal; Kolmogorov-Smirnov test doesn't agree


Proof that if higher moment exists then lower moment also exists


Given the power of computers these days, is there ever a reason to do a chi-squared test rather than Fisher's exact test?


If you know a factor is significant, what is a reason why R might think it's not?


How to calculate the signal-to-noise ratio (SNR) in an image?


How can I generate data with a prespecified correlation matrix?


Math Statistics Bell Curve Computing % correct given 2 numbers (C#)


Correlated Regressors - Motorway Accidents


How to create a z-score table


Is it meaningful to calculate Pearson or Spearman correlation between two Boolean vectors?


Trigonometric operations on standard deviations


Highly unbalanced test data set and balanced training data in classification


Logistic Regression - Model Selection Method


What is the real answer to the Birthday question?


What could it mean to "Rotate" a distribution?


How to test hypothesis of no group differences?


How to test a Random Number generator in R?


Help me understand Bayesian prior and posterior distributions


Book Recommendation for Mathematical Statistics


Bayesian and frequentist approaches: What are some success stories for the former?


Reference with distributions with various properties


How to the predict the number of daily visitors in six months' time based on the past three?


What is the expected correlation between residual and the dependent variable?


How often do you have to roll a 6-sided dice to obtain every number at least once?


How do I reference a regression model's coefficient's standard errors?


How to scale a variable to a specific mean and standard deviation


How to analyze a variable measured on a Likert scale and its interaction with another variable?


Maximum Likelihood formula for Naive Bayes


Why is "statistically significant" not enough?


Examples for teaching: Correlation does not mean causation


Random permutation of a vector with a fixed expected sample correlation to the original?


calculate partial autocorrelation


Fitting a logistic regression using lassoglm in matlab


Looking for good introductory treatment of meta-analysis


AR(1) coefficient is correlation?


When are Log scales appropriate?


Meaning of probability notations $P(z;d,w)$ and $P(z|d,w)$


How to get SSE for predictions using SAS?


Linear regression not fitting well


How can I efficiently model the sum of Bernoulli random variables?


Why would adjusting in a model change the direction of an effect?


How to analyze data with more than one associated categorical dependent variables?


Strange pattern of residuals


Probability of mean of random sample being in a certain range


Non-significant intercept in regression with a two level factor in R


Separating two populations from the sample


Probability of getting between


Optimal software package for bayesian analysis


Calculating standard deviation associated with percentage change


Adding new item to recommender's options?


Does the slope of a regression between observed and predicted values always equal the $R^2$ of the original model?


How to interpret the output for calculating concordance index (c-index)?


UnReSolved Mean Adjust DataSet to achieve .5 Mean


Mann Whitney test with unequal variances


Use of kernel density estimate in Naive Bayes Classifier?


Cross-validation for mixed-effect logistic regression?


Confidence interval for the product of two parameters


What is the difference between Variance and Standard Deviation (SD) intuitively?


Fisher-type unit-root test for panel data. Results interpretation in Stata


cluster - class dependency bag of words


Can the empirical Hessian of an M-estimator be indefinite?


In what order should you do linear regression diagnostics?


Simple combination/probability question based on string-length and possible-characters


Effect of moving average parameter on variability and variance of demand


Central limit theorem for sample medians


how to create predictive model in R when outcome variable has more than 10 classes


How to check if data constitute a time series with simple moving average method?


What is the benefit of breaking up a continuous predictor variable?


How do I use a mean and 95% confidence intervals to draw from a distribution?


Converting standardized betas back to original variables


Performance evaluation of auto.arima in R and UCM on one dataset


Improvement of regression model