How do you properly forecast housing need so your development curve (and the foundational urban planning necessary) aligns with the housing demand curve while keeping said housing affordable?

The CCP seems to have been very successful with their "build an entire city and move people into it model" (seeing the cities have filled), but I'm unsure how it works in a more capitalistic model.