John Chrysostom
Having stated his decision briefly and without delay, he then again turns to the Corinthians and uses rebuke: “Your boasting is not good,” 1 Cor 5:6. He shows that, by boasting of him, they were the cause of his impenitence until the present time.
Then he explains that he does this for the good not only of the sinner, but of them all: “Do you not know,” he continues, “that a little leaven leavens the whole lump?”
Although the sin, he says, is his, if it is left unattended, it can infect the whole body of the Church. For if the first one who sinned is not delivered to punishment, others will soon fall into the same sin.
By these words he indicates that they should fear and care for the whole Church, and not only for one member. For this reason he uses the image of leaven.
As leaven, he says, though small, changes the whole dough, so this man too, if he remains without rebuke and his sin without punishment, will infect the rest.