Why do factions pose a challenge to legislation?

Madison concludes that the damage caused by faction can be limited only by controlling its effects. He then argues that the only problem comes from majority factions because the principle of popular sovereignty should prevent minority factions from gaining power.