You are misunderstanding that. It's "within the borders" not "across the borders." The second clause of Article 13 grants rights to leave countries, and to return to "his" country, which implies a right to deny non-citizens entry.

That countries can (as a rule) deny non-citizens entry for whatever reason they so desire should be obvious.