The change in distance is actually minimal. Earth's tilted axis is the real cause of seasons on Earth.

Even though Earth's orbit is an ellipse, the change in distance from the Sun is only an optical illusion.

The change in distance is the real cause of seasons on Earth.

The change in distance occurs at the same time as the seasons, so we don't notice the change.