If you're looking for something simple to try work it out, I bought a smart plug a few years back which could record usage for around 20USD, you can then move it between your devices getting a sense of each's usage.
Long term tracking usage of individual device energy usage is nice, but just knowing from past measurements how much a device tends to use is already very useful.
If you're going to go down this route and aren't afraid of a little DIY, then I'd highly recommend something that doesn't depend on the cloud.
Either ESPhome- or Tasmota-based plugs are great if you want fully local control (e.g. Athom, LocalBytes), or Shelly for local-first control with an option of connecting to their cloud.
Mostly everything else will lock you into the manufacturer's app & cloud. Zigbee is fully local too, but it requires additional hardware.
Long term tracking usage of individual device energy usage is nice, but just knowing from past measurements how much a device tends to use is already very useful.