Offline-ready lesson · progress saves on this device
Typing practiceStudy workspace →
Courses/Machine Learning/Lesson 3

Lesson 3 of 6

Polynomial Regression & Model Tuning

Read the overview in
English overview

Compare linear and polynomial models with mean squared error, add complexity only when it improves unseen predictions, and diagnose underfitting and overfitting.

1 hr 30 minIntermediateDetailed notes6 flashcards + 6 questions
Course outlineMachine Learning with Python

Why this lesson matters

Compare linear and polynomial models with mean squared error, add complexity only when it improves unseen predictions, and diagnose underfitting and overfitting.

The goal is not to memorize vocabulary. By the end of the lesson, you should be able to use the ideas in a realistic situation, explain the reason for your choices, and check whether the result actually works for the intended person or task.

Learning objectives

  • Explain Mean squared error in your own words.
  • Apply Underfitting to a realistic classroom or community example.
  • Connect Mean squared error with Overfitting when making a decision.
  • Complete the practice task and reflect on one improvement.

Core ideas

1. Mean squared error

The average squared difference between predictions and observed values, giving larger mistakes more influence on the score.

In practice: Look for this idea while you complete the lesson task. Pause before each major step and explain how Mean squared error changes what you choose, create, or check.

2. Underfitting

A model is too simple to capture important structure, so it performs poorly even on the data used for training.

In practice: Look for this idea while you complete the lesson task. Pause before each major step and explain how Underfitting changes what you choose, create, or check.

3. Overfitting

A model follows training noise or details too closely and therefore performs worse on new data.

In practice: Look for this idea while you complete the lesson task. Pause before each major step and explain how Overfitting changes what you choose, create, or check.

How the ideas connect

Start with Mean squared error to understand the foundation of the lesson. Use Underfitting to turn that understanding into an action. Then apply Overfitting to check the quality, safety, or usefulness of the result. The three ideas are strongest when you can explain their relationship rather than treating them as separate definitions.

Guided walkthrough

  1. Name the goal. In one sentence, write what you are trying to understand, create, or improve.
  2. Make a prediction. Before touching a device, use Mean squared error and Underfitting to predict what a strong result should look like.
  3. Complete the task. Compare three candidate curves using training and test MSE. Choose the best model for new data and defend the choice without selecting only the lowest training error.
  4. Check the outcome. Use Overfitting to inspect the result. Ask what worked, what did not, and what evidence supports your judgment.
  5. Explain and revise. Tell a partner what you changed and why. Make one small improvement, then compare the new result with the first one.

Worked classroom scenario

Imagine two learners sharing one device. The first learner is the driver and performs the steps; the second is the navigator and reads the goal, predicts the next step, and checks the result. Halfway through the task, switch roles. Both learners should be able to explain how Mean squared error, Underfitting, and Overfitting appeared in the work.

If no device is available, complete the same reasoning on paper: sketch the screen or result, label each decision, and describe what you would test when a device becomes available.

Common mistakes and fixes

  • Rushing into the tool: Write the goal and prediction first so every click or step has a reason.
  • Copying without understanding: After each major step, explain it in your own words to a partner.
  • Accepting the first result: Compare the outcome with the goal and make at least one deliberate improvement.
  • Letting one person control a shared device: Rotate driver and navigator roles so both learners think and practice.

Independent practice

Compare three candidate curves using training and test MSE. Choose the best model for new data and defend the choice without selecting only the lowest training error.

For an extra challenge, adapt the task for a different audience or community need. Write two sentences explaining what changed and which lesson idea guided your decision.

Check your understanding

  1. How would you explain Mean squared error to someone new to the topic?
  2. What is one realistic example of Underfitting outside this classroom?
  3. When might Overfitting prevent a weak, unsafe, or confusing result?
  4. How are Mean squared error and Underfitting connected?
  5. What evidence would convince you that your practice result works?
  6. If you repeated the activity tomorrow, what would you improve first and why?

Key takeaway

Compare linear and polynomial models with mean squared error, add complexity only when it improves unseen predictions, and diagnose underfitting and overfitting.

You are ready to move on when you can explain the three core ideas, complete the practice without copying, and describe one improvement using evidence from your result.