CS-EJ3211 Linear Regression - MSE, MAE and Huber

Published: 29 January 2022
on channel: Alexander Jung
2,435
45

Dr. Shamsiiat (Shamsi) Abdurakhmanova discusses linear regression methods, which are among the most widely used machine learning methods. Linear regression methods learn a linear hypothesis map whose predictions incur minimum (average) loss on a given training set of labeled data point. We obtain different linear regression methods by using different loss functions.

The choice of loss function in regression methods crucially influences their statistical and computational properties. As a point in case, using the average squared error loss ("MSE") is computationally appealing as it allows for implementations with low computational complexity. On the other hand, using the (computationally less appealing) average absolute error loss ("MAE") is statistically appealing as it results in ML methods that are robust against the presence of outliers in the training set.

Read more about linear regression methods in Chapter 3 of
A. Jung, "Machine Learning: The Basics,", Springer, Singapore, 2022. (draft: mlbook.cs.aalto.fi)


Watch video CS-EJ3211 Linear Regression - MSE, MAE and Huber online without registration, duration hours minute second in high quality. This video was added by user Alexander Jung 29 January 2022, don't forget to share it with your friends and acquaintances, it has been viewed on our site 2,435 once and liked it 45 people.