AI models are increasingly effective in geographical applications, such as mapping roads, buildings, and land use from images. However, these models are purely data-driven, leading to energy-intensive training and occasional misclassifications. They also lack geographical knowledge—spatial relationships grounded in common sense, logic, scientific observations, and physical rules.
The project, a cooperation between GIScience and HeiGIT, aims to bridge this gap by integrating geographical knowledge into AI models for enhanced accuracy and efficiency.
Unlike physics, where data can often be represented through deterministic equations, geographical knowledge cannot be fully vectorized. Real-world geographical objects, however, indirectly reflect this knowledge, as humans naturally act upon it. This becomes evident in AI-generated mapping data: while models may perform accurately in well-represented environments, they often produce errors in diverse or less familiar contexts due to a lack of true geographical understanding. Integrating geographical knowledge into AI models can reduce such errors, making mapping more reliable across diverse environments.
AI-generated road data from Microsoft (2020) in an urban environment
An image on the right showcases a notable error where AI misinterprets furrows in agricultural land as roads. This highlights the limitations of current AI models in understanding complex, unstructured landscapes.
AI-generated road data from Microsoft (2020) includes a notable example of erroneous image interpretation
The primary objective of this project is to investigate how incorporating geographical knowledge into AI models can:
What constitutes geographical knowledge, and how can it be represented as vectorized data?
What are effective ways to integrate geographical knowledge into AI models?
How do these implementations affect the models’ efficiency and predictive performance?
We plan to use OpenStreetMap (OSM) as a database to extract and generalize geographical knowledge for AI models. As the world’s largest community-based Volunteered Geographic Information (VGI) mapping project, OSM’s open structure allows for broader application and generalization to various tasks.