subject
Mathematics, 14.10.2020 01:01 CSelmon23

It is well-known that ridge regression tends to give similar coefficient values to correlated variables, whereas lasso may give quite different coefficient values to correlated variables. We will now explore this property in a very simple setting. Assume n are the number of training samples, p the number of dimensions, x in the input and y the output. Suppose that n = 2, p = 2, x11 = x12, and x21 = x22. Furthermore, suppose that y1 + y2 = 0 and x11 + x21 = 0 and x12 + x22 = 0, so that the estimate for the intercept in a least squares, ridge regression, or lasso model is zero: βˆ 0 = 0. (a) Write out the ridge regression optimization problem in this setting. (b) Argue that in this setting, the ridge coefficient estimates satisfy βˆ 1 = βˆ 2. (c) Write out the lasso optimization problem in this setting. (d) Argue that in this setting, the lasso coefficients βˆ 1 and βˆ 2 are not unique – in other words, there are many possible solutions to the optimization problem. Describe these solutions

ansver
Answers: 2

Another question on Mathematics

question
Mathematics, 21.06.2019 13:50
James wants to promote his band on the internet. site a offers website hosting for $4.95 per month with a $49.95 startup fee. site b offers website hosting for $9.95 per month with no startup fee. for how many months would james need to keep the website for site a to be a better choice than site b? 1. define a variable for the situation. 2. write an inequality that represents the situation. 3.solve the inequality to find out how many months he needs to keep the website for site a to be less expensive than site b. 4. using words, describe how many months he needs to keep the website for site a to be less expensive than site b.
Answers: 3
question
Mathematics, 21.06.2019 19:00
What is the expression in factored form? -20x^2 - 12x a. 4x(5x+3) b. -4x(5x-3) c. -4(5x+3) d. -4x(5x+3)
Answers: 2
question
Mathematics, 21.06.2019 20:00
I’m stuck on this equation, anyone got the answer?
Answers: 1
question
Mathematics, 22.06.2019 01:30
The difference between the number of electoral votes for florida and north carolina is 12 votes. write and solve a subtraction equation to find a number of electoral votes for florida.
Answers: 3
You know the right answer?
It is well-known that ridge regression tends to give similar coefficient values to correlated variab...
Questions
question
Mathematics, 30.07.2019 07:00
question
English, 30.07.2019 07:00
Questions on the website: 13722363