> has predominantly been from the hands of men.

That should probably read "rich people", because while, yes, it was usually men doing the dirty work of enslaving other men, it was usually rich families who reaped the rewards.