The same points, fitted by polynomials of rising order. Watch Rยฒ climb โ and watch where climbing stops meaning the fit got better and starts meaning it got bendier. Click the plot to add a point, click a point to drop it.
Order 1 is already the honest answer. Every order above it is the curve learning the noise.
14 points
Remove a point
What it is doing
Ordinary least squares โ it minimises the sum of squared vertical distances, so one far-off point pulls harder than several near ones. Drop an outlier onto the plot and watch it drag the curve.
Rยฒ never falls when the order rises. That is arithmetic, not evidence: every higher order contains the lower one as a special case, so it can always do at least as well on the points it was shown.
The interesting number is the one you cannot see here โ the error on points the fit was not given. That is what stops rising, and usually well before the last order on the slider.