Nostalgin: Extracting 3D City Models from Historical Imagery

Nostalgin: Extracting 3D City Models from Historical Imagery

Amol Kapoor, Hunter Larco and Raimondas Kiveris

More on

have you ever looked at an old photograph and wondered what it might have been like to experience history firsthand to walk through old neighborhoods and roadways observing buildings that have long since disappeared introducing nostalgia the nostalgia engine nostalgia niz a city engine that uses historical imagery to reconstruct city models at scale nostalgia can generate a city model even if there is only a single image per building facade regardless of viewpoint or occlusions in this presentation we briefly discussed the design considerations of working with historical data and present an overview of the nostalgia architecture please see the paper for a more in-depth review of our work historical data is more constrained than modern data historical images are significantly more sparse and they are missing important metadata like pose or focal length often we only have the raw pixels to work with and even those pixels can be grainy or damaged nostalgia is designed to make up for these constraints we utilize state of the art techniques and image segmentation image matting rectification and in painting to extract clean building facade data from photographs using user-provided geo data we model each building and place it in the larger world for each sub component we add modifications and optimizations to improve accuracy and speed some of our optimizations are we introduce an alpha matting component after segmentation to improve boundary lines we utilize a custom line detection algorithm to get smarter rectification results and we modify deep in painting techniques to be faster and more scalable our goal for nostalgia is to allow users to experience a world that no longer exists we aim to create an open-source platform where users can contribute their own photos and generate immersive historical experiences that will allow them to connect to Prior eras of history such a platform would help us further generalize install j'en allowing us to move towards more detailed 3d reconstruction nostalgia extracting 3d city models from historical image data you

Leave a Reply

Your email address will not be published. Required fields are marked *