Tag: Normal Equations

• Linear Regression and Least Squares: Reading the Normal Equations as an Orthogonal ProjectionDerives the normal equations X^T X w = X^T y from least squares both algebraically and by calculus, shows the fit is an orthogonal projection onto the column space, and treats rank and conditioning.Computer ScienceMathematics for Machine LearningUndergraduateLinear RegressionLeast SquaresNormal EquationsOrthogonal ProjectionHat Matrix~38 min