I recall seeing research that immediacy and inevitability of punishment have way more effect on re-offense rates than harshness of the punishment.

That said, incarcerating people is liable to immerse them into the hardened criminal culture, which is not productive and calls for some alternatives.