It was after the initial comment was downvoted.

Downvoting without asking for rationale was the reason he stopped worrying about comment votes, not the other way around.

The fact that lots of people are doing some thing, doesn't make this thing right. After all, "I did it because the other guy did it" is an excuse for children.