The last time I read some studies on the subject of physical discipline, the conclusion was closely aligned with what you observed. Children who were physically disciplined but understood their parents loved them and had a consistent approach to the discipline had no negative long-term effects from the discipline, whereas those who were arbitrarily "disciplined" (really, just abuse if it's arbitrary) or didn't have an understanding of their parents' love for them had significant negative effects from the abuse.