Well, the Moors, then the Berbers. Then the caliphate of Córdoba broke into smaller kingdoms whose territories were retaken little by little. It is interesting to consider that the Moors took the entire peninsula en four years and the reconquest took almost 800!