I have plans to add support for iTerm format, but I'm not a Mac user, while of the work should not be on the derasterize part (image -> unicode text: easy), but on the passthrough part (when to abandon the image).

If you are a Mac user, could you please consider writing a patch? The ability to dogfood it means whatever you write will still be better than whatever I may come up with.