The geomagnetic field is a field. It is not a solid physical object. Apparently, the location of the magnetic field moves around.

The terms North and South Poles also refer to the the place where the longitude lines converge. So, the North and South pole are well defined points.