Location and vision are separate senses. I'm completely aphantasic, but of course I can orient myself in remembered spaces. Fictional spaces are more difficult, but not impossible if the description is good.