Kolka, in Estonian (kolgas) can mean something like "remote corner of the earth" and it suits this place. Findings from Wikipedia - The Livonian name Kūolka means "corner" in English.