That's how society handled snakes and demons for most of human history. It's arguable societal decline stems from moving away from this approach.

If the law is the primary obstacle preventing the majority from beating unscrupulous CEOs to within an inch of their life, then perhaps the majority should consider passing legislation that permits this as the current set of laws has abjectly failed.