The time was very different. Most people lived and worked in the country, not in cities, so de facto they couldn’t control them however they liked. Christian Church was also imposing morality over everything, which means they couldn’t enslave people as easily as today.

We are living in neo-feudalism. Your boss is a lord, and your only freedom is to choose a lord, provided this lord accept you.