THERE WERE ARAB MUSLIMS AND THERE WERE BLACK AFRICAN MUSLIMS

and all colors in between. India Muslims, for example.

For the conquistadors, and later for other Europeans, it was OK to enslave any of them.

They were personae non gratae in the Christian New World, anyway, except as slaves.