All Flashcards
What is the definition of a residual?
The difference between the observed value (y) and the predicted value (ŷ).
What is the definition of a residual plot?
A scatterplot of the residuals (y - ŷ) against the predictor variable (x).
Define a positive residual.
The model underestimated the true value; actual value is higher than predicted.
Define a negative residual.
The model overestimated the true value; actual value is lower than predicted.
What does a random scatter of residuals indicate?
A linear model is appropriate.
What is the formula for calculating a residual?
What is the goal of a linear regression model in terms of residuals?
Minimize the sum of the squared residuals (least squares criterion).
How do you calculate the predicted value (ŷ) using the Least Squares Regression Line (LSRL)?
Using the equation of the LSRL: ŷ = a + bx, where a is the y-intercept and b is the slope.
Given the LSRL and a data point (x, y), how do you calculate the residual?
- Find the predicted value (ŷ) using the LSRL. 2. Subtract the predicted value from the actual value (y): Residual = y - ŷ.
What does a residual of 0 indicate?
The model perfectly predicted the observed value.
Explain the concept of a residual plot and its purpose.
A residual plot is a graph that displays residuals on the y-axis and predictor variable on the x-axis. It helps assess the appropriateness of a linear model.
Explain the concept of 'least squares criterion'.
The 'least squares criterion' aims to minimize the sum of the squares of the residuals, ensuring the best fit for the regression line.
Explain what a pattern in a residual plot suggests.
A pattern (e.g., curve, funnel) suggests that a linear model is not appropriate for the data and a non-linear model might be a better fit.
Explain what a random scatter in a residual plot suggests.
A random scatter suggests that a linear model is a good fit for the data, as there's no systematic pattern in the residuals.
What does it mean if a linear model 'overestimates' a value?
The predicted value (ŷ) from the model is higher than the actual observed value (y). This results in a negative residual.
What does it mean if a linear model 'underestimates' a value?
The predicted value (ŷ) from the model is lower than the actual observed value (y). This results in a positive residual.