Handbook of Geospatial Approaches To Sustainable Cities 1st Edition Qihao Weng Download
Handbook of Geospatial Approaches To Sustainable Cities 1st Edition Qihao Weng Download
https://ebookbell.com/product/handbook-of-geospatial-approaches-
to-sustainable-cities-1st-edition-qihao-weng-56484220
https://ebookbell.com/product/handbook-of-geospatial-artificial-
intelligence-song-gao-yingjie-hu-54993888
https://ebookbell.com/product/the-routledge-handbook-of-geospatial-
technologies-and-society-1st-edition-alexander-j-kent-50795592
Handbook Of Big Geospatial Data 1st Edition Martin Werner Yaoyi Chiang
https://ebookbell.com/product/handbook-of-big-geospatial-data-1st-
edition-martin-werner-yaoyi-chiang-26746742
https://ebookbell.com/product/handbook-of-research-on-geospatial-
science-and-technologies-1st-edition-joyce-gosata-maphanyane-54012514
Handbook Of Psychology Developmental Psychology Richard M Lerner M A
Easterbrooks Jayanthi Mistry
https://ebookbell.com/product/handbook-of-psychology-developmental-
psychology-richard-m-lerner-m-a-easterbrooks-jayanthi-mistry-44869188
https://ebookbell.com/product/handbook-of-home-language-maintenance-
and-development-andrea-c-schalley-44875220
https://ebookbell.com/product/handbook-of-what-works-with-sexual-
offenders-contemporary-perspectives-in-theory-assessment-treatment-
and-prevention-1st-edition-jean-proulx-44880746
https://ebookbell.com/product/handbook-of-dialysis-therapy-6th-
edition-allen-r-nissenson-richard-n-fine-rajnish-mehrotra-joshua-
zaritsky-44887338
https://ebookbell.com/product/handbook-of-revolutions-in-the-21st-
century-the-new-waves-of-revolutions-and-the-causes-and-effects-of-
disruptive-political-change-1st-edition-jack-a-goldstone-
editor-44887720
Handbook of Geospatial
Approaches to Sustainable Cities
Features:
This book is intended for researchers and scientists interested in learning techniques
in GeoAI, including the technologies for collecting, analyzing, managing, processing,
and visualizing geospatial datasets.
Imaging Science Series
Qihao Weng
Hong Kong Polytechnic University
Edited by
Qihao Weng
in collaboration with Cheolhee Yoo
© 2024 selection and editorial matter, Qihao Weng; individual chapters, the contributors
Reasonable efforts have been made to publish reliable data and information, but the author
and publisher cannot assume responsibility for the validity of all materials or the
consequences of their use. The authors and publishers have attempted to trace the copyright
holders of all material reproduced in this publication and apologize to copyright holders if
permission to publish in this form has not been obtained. If any copyright material has not
been acknowledged please write and let us know so we may rectify in any future reprint.
Except as permitted under U.S. Copyright Law, no part of this book may be reprinted,
reproduced, transmitted, or utilized in any form by any electronic, mechanical, or other
means, now known or hereafter invented, including photocopying, microfilming, and
recording, or in any information storage or retrieval system, without written permission from
the publishers.
For permission to photocopy or use material electronically from this work, access
www.copyright.com or contact the Copyright Clearance Center, Inc. (CCC), 222 Rosewood
Drive, Danvers, MA 01923, 978-750-8400. For works that are not available on CCC please
contact [email protected]
Trademark notice: Product or corporate names may be trademarks or registered trademarks
and are used only for identification and explanation without intent to infringe.
Typeset in Times
by MPS Limited, Dehradun
Contents
Preface.....................................................................................................................xiii
Acknowledgments...................................................................................................xvi
Editors ....................................................................................................................xvii
Contributors ..........................................................................................................xviii
Index......................................................................................................................348
Preface
Geospatial technology is one of the three most important, evolving fields in the
21st century, along with nanotechnology and biotechnology. Earth Observation (EO)
technologies, in conjunction with field surveys, have been used to observe, monitor,
measure, and model many of the components that comprise the ecosystems, contributing
to the sustainability and productivity of natural and human systems. Driven by societal
needs and improvement in geospatial technology, we have witnessed a great increase in
research and development, technology transfer, and engineering activities worldwide.
Their integration with the Internet and communications technologies, as well as
Geographic Information System, have led to the emergence of geospatial big data over
the web and on hands. These geo-referenced big data and imagery, in conjunction with
GPS, mobile mapping, and modern telecommunication technologies, have sparked
increasing interest in governments, industries, and the public.
Artificial Intelligence (AI), especially deep learning, has transformed the field of
computer vision, and now rivals human-level performance in certain tasks, such as
image recognition and semantic segmentation. In this context, there is a strong need
for research and development of new approaches to multi-sensory and multi-modal
deep learning within the new processing and recognition frameworks of remotely
sensed imagery. Since the 21st century, with the improvement of spatial resolution
of remote sensing images, image classification methods have gradually developed
into three parallel branches at different levels: pixel-level, object-level, and scene-
level classification. Many AI-based methods employ scene classification, which
uses the layout of objects within the scene, in addition to the ambient context, for
classification. It requires solving the problems in data training and validation, model
generalization across different modalities of EO images, and supercomputing
power. In recent years, AI has shown great promise to fulfil the challenging need
for image processing. AI can aid in the collecting and processing of image data
using neural networks and deep learning models and through Computer Vision
models to better understand and interpret data more efficiently. Since circa 2016,
we have witnessed the convergence of the improved capacities in geospatial and
AI technology, leading to a new field of Geospatial AI (abbr. GeoAI).
This book explores the convergence of geospatial technology, GeoAI, big data,
and sustainable urban development, providing insights into the nexus of these fields,
the current state, and future potentials. It consists of four sections, each addressing a
unique aspect of these synergies. This book would be of great value for researchers,
students, and professionals in the fields of geospatial technologies, AI, urban
science, and sustainability science.
xvi
Editors
Qihao Weng, a Foreign Member of The Academy of Europe (Academia Europaea)
and a Fellow of IEEE, AAAS, AAG, ASPRS, and AAIA, is currently a Chair
Professor at the Hong Kong Polytechnic University and has worked as the Director
of the Center for Urban and Environmental Change and a Professor of Geography
at Indiana State University, 2001–2021, and a Senior Fellow at the National
Aeronautics and Space Administration from 2008 to 2009. He received his Ph.D. in
geography from the University of Georgia in 1999. Weng is the Lead of GEO
Global Urban Observation and Information Initiative, 2012–2022, and an Editor-in-
Chief of ISPRS Journal of Photogrammetry and Remote Sensing. Additionally, he
serves as the Series Editor of Taylor & Francis Series in Remote Sensing
Applications, and Taylor & Francis Series in Imaging Science. Weng has been
the Organizer and Program Committee Chair of the biennial IEEE/ISPRS/GEO
sponsored International Workshop on Earth Observation and Remote Sensing
Applications conference series since 2008; a National Director of American Society
for Photogrammetry and Remote Sensing from 2007 to 2010; and a panelist of U.S.
DOE’s Cool Roofs Roadmap and Strategy in 2010.
xvii
Contributors
Ren Chao Siwoo Lee
The University of Hong Kong Ulsan National Institute of Science
Hong Kong S.A.R., China and Technology
Ulsan, South Korea
Haojie Chen
The Hong Kong Polytechnic University Yong Li
Hung Hom, Kowloon, Hong Kong The Hong Kong University of Science
and Technology
Yang Chen Hong Kong, China
Wuhan University
Wuhan, China Zhiwei Li
The Hong Kong Polytechnic University
Dongjin Cho Hung Hom, Kowloon, Hong Kong
Ulsan National Institute of Science
and Technology Xintao Liu
Ulsan, South Korea The Hong Kong Polytechnic University
Hung Hom, Kowloon, Hong Kong
Hai Guo
The Hong Kong Polytechnic University Cai Meng
Hung Hom, Kowloon, Hong Kong Wuhan University
Wuhan, China
Ce Hou
The Hong Kong University of Science Yamin Qing
and Technology The Hong Kong Polytechnic University
Hong Kong, China Hung Hom, Kowloon, Hong Kong
xviii
Contributors xix
Zidong Yu
The Hong Kong Polytechnic University
Hung Hom, Kowloon, Hong Kong
Part I
Artificial Intelligence and
Big Data Analytics
Needs and Requirements
1 Sensing Urban Physical
Environment with GeoAI
and Street-Level Imagery
Ce Hou, Yong Li, and Fan Zhang
INTRODUCTION
Sensing the urban physical environment is crucial to understanding, managing,
planning, and designing cities. The paramount significance of the urban physical
environment has been repeatedly emphasized by landscape architects, urban
planners, and researchers. The “City Beautiful Movement”, which flourished
from the 1890s to the 1920s, was a dedicated endeavor aimed at enhancing the
quality of the urban living environment and elevating people’s overall quality of life
through the improvement of cities’ physical surroundings. This movement sought to
augment the aesthetic appeal of urban areas, creating a more visually pleasing and
comfortable perception of the city (Wilson, 1989). In Kevin Lynch’s masterpiece
The Image of the City, he provides a comprehensive exploration of how urban
residents perceive and construct their own perception of the physical environment
within the city (Lynch, 1964). The concept of investigating the human-centered
perception of the urban physical environment has exerted a significant influence on
numerous urban planning theorists, including William H. Whyte, Jane Jacobs, and
Jan Gehl (Jacobs, 2016; Whyte et al., 1980; Gehl, 2013). By sensing the physical
environment of a city, urban planners and designers gain more profound insights
into its distinctive attributes and intricacies. This understanding enables them to
devise effective strategies and solutions aimed at bolstering the sustainability,
livability, and overall quality of life for the city’s inhabitants (Zhang et al., 2019).
In the past few decades, various methodologies for perceiving and analyzing
the physical urban environment have been developed, refined, and employed.
Before the flourishing of information technology, traditional work of sensing the
urban physical environment primarily relied on manual observation methods,
such as questionnaires, census data, and geographic measurements (Hoehner
et al., 2005; Galea et al., 2005; Handy et al., 2002). For instance, urban
researchers physically visited cities, meticulously observed buildings, roads,
and traffic patterns, and collected valuable insights from residents through
questionnaires and interviews (Davison and Lawson, 2006; Frank et al., 2005).
Traditional surveying tools and maps were utilized to gather geographical data
pertaining to the city, including topographical features and architectural structures
DOI: 10.1201/9781003244561-2 3
4 Handbook of Geospatial Approaches to Sustainable Cities
(Harley, 1990; DeMers, 2008). These manual-based urban sensing methods are
often labor-intensive, time and resource-consuming, and sometimes difficult to
implement (Fleischhacker et al., 2013).
The advancement of information technology has led to the emergence of urban
sensing methods utilizing remote sensing (RS), global positioning systems (GPS),
and geographic information systems (GIS), which enables deeper sensing of the
urban physical environment (Liang and Weng, 2010; Miller and Small, 2003). RS
technology provides large-scale imagery data with a high spatio-temporal resolu-
tion, facilitating the acquisition of large-scale information on cities, such as city
sprawl, land use, and vegetation cover (Ji et al., 2006; Alqurashi and Kumar, 2013;
Xie et al., 2008). Moreover, a wide range of sensor data enables real-time sensing of
various physical environmental parameters in cities, including climate conditions,
air quality, and urban noise (Dutta et al., 2009). GPS enables the sensing of the
urban physical environment through the collection of travel tracks from city
dwellers (Van der Spek et al., 2009). By leveraging GPS, large volumes of location
data can be gathered and utilized to analyze parameters such as traffic flow and
travel patterns and to assess challenges such as road congestion and traffic safety
(Kamran and Haas, 2007; Zheng et al., 2009). Subsequently, the integration of
multiple data sources within a GIS platform allows for the overlay analysis of
geographic data and the identification of spatial relationships, leading to a deeper
understanding of the characteristics, challenges, and potential solutions related to
the urban physical environment (Jat et al., 2008; Liang and Weng, 2010). The
emergence of multi-source big data and GIS technologies enables sensing the urban
physical environment from various perspectives and scales, extracting valuable
information and patterns that unveil trends and problematic areas within the urban
landscape. In this context, using street-level Imagery (SI) and geospatial artificial
intelligence (GeoAI) are valuable complements, providing fine-grained spatial
visual information and advanced spatial analysis techniques. These advancements
further enhance urban physical sensing methodologies, enabling scholars to uncover
more comprehensive information previously hidden within the city (Zhang 2023a,
2023b, 2023c).
Notably, utilizing SI and GeoAI to conduct urban sensing has demonstrated
remarkable potential in recent years. In contrast to the aforementioned urban
sensing methods, SI effectively supplements urban analysis data sources, particu-
larly from a human perspective (Zhang et al., 2018; Dubey et al., 2016b). Unlike
satellite imagery and aerial imagery, which capture information from vertical or
oblique viewpoints, SIs provide more detailed visual information at the neighbor-
hood level (shown in Figure 1.1), which is aligned with the human perspective of
observing the urban physical environment (Kang et al., 2020; Biljecki and Ito,
2021). Consequently, SIs enable virtual urban audits for governmental purposes and
assist urban planners in investigating people’s objective perceptions of places,
fostering a better understanding of human-land interaction within the city (Kang
et al., 2023). The rapid development of GeoAI technology further amplifies SI’s
potential for information mining (Zhang et al., 2023a, 2023b, 2023c). By leveraging
SIs and GeoAI, we possess the capacity to not merely evaluate the condition of
urban infrastructure by employing semantic segmentation methodologies (Xiao and
Urban Sensing with GeoAI and Street‐Level Imagery 5
FIGURE 1.1 Examples of (a) satellite imagery, (b) aerial imagery, and (c) street view imagery.
Quan, 2009; Rundle et al., 2011; Li et al., 2015b; Gong et al., 2018), but also to
distill more profound insights concealed within the visual data, including safety,
architectural age and style, as well as the urban socio-economic environment
(Zhang et al., 2021; Sun et al., 2022; Suel et al., 2019). The combination of SI and
GeoAI enhances the existing research paradigm established since the inception of
geographic information science and technology, thus broadening the spectrum of
urban physical environment sensing.
Within the scope of this article, we conduct an overview of prevailing studies
centered around the integration of SI and GeoAI for the purpose of sensing the
urban physical environment, concurrently discussing the applications and achieve-
ments within the discipline of urban science. Furthermore, we have addressed the
shortcomings inherent in current research endeavors and have projected potential
avenues for future exploration.
Bing Maps Streetside, Here Street View, Baidu Street View, AutoNavi, and
Tencent Street View.
One of the main advantages of commercial SI is its high data quality.
Commercial providers invest significant resources in data collection, processing,
and maintenance, resulting in consistent image quality during shooting and
processing. As a result, commercial SI often has higher standards for image
quality, resolution, coverage, and update frequency.
In addition, commercial SI typically has extensive global coverage, including in
rural and urban areas, and across multiple countries. This is due to the greater
resources available to commercial providers, which allows them to ensure that
street-view imagery is available in more areas. As such, commercial SI has become
an invaluable resource for applications such as urban planning, transportation,
tourism, and GIS.
Crowdsourcing SI, such as those provided by Mapillary and OpenStreetView,
is a freely accessible resource contributed and maintained by various entities,
including academic institutions, government departments, and community projects
(Juhasz and Hochmair, 2016). These sources of SI are often supplemented by data
collected from self-driving cars and other methods.
However, the quality of crowdsourced SI may vary depending on the
contributor, including aspects such as image resolution, coverage, and update
frequency. As such, the data quality of crowdsourced SI may not be as consistent
or high-precision as that of commercial SI. Additionally, crowdsourced SI has
limited coverage, especially in remote areas (Yan et al., 2020; Goodchild, 2007;
Goodchild and Li, 2012). Despite these limitations, crowdsourced SI remains a
valuable resource for various applications, particularly in areas where commercial
SI is unavailable or insufficient.
SENSING TASKS
Sensing the urban physical environment with SI can be categorized into the
following tasks (Table 1.1).
Scene Perception
Scene perception is based on typical image classification models. Scene perception
models are mainly based on the Place Pulse 2.0 database (Dubey et al., 2016a),
which contains one million human ratings on street-level images along six
dimensions: “safe”, “lively”, “beautiful”, “wealthy”, “boring”, and “depressing”.
The models trained on Place Pulse have been proven to be effective in estimating
these perceptual dimensions of new scenes in most cities.
Scene Inference
Beyond information from visible scenes, scene inference models aim at inferring
the scene information that cannot be directly observed from the visible scenes, such
as crime (Khosla et al., 2014), real estate values (Law et al., 2019), and long-term
human dynamics (Zhang et al., 2019), etc. These kinds of models are trained
through an end-to-end learning process, in which the model automatically learns
efficient features between the initial input image and the final output labels (crime
rate, house price value, etc.), without manually indicating what visual cues matter to
the model.
Scene Embedding
Scene embedding aims to learn and represent a scene with a generic feature, which
is typically a vector of continuous numbers that capture the semantics of a scene. As
a computational representation, this vector makes scenes computable, which can be
used either to measure similarity among scenes or as the input of other machine
learning tasks (Ye et al., 2020; Zhu et al., 2020a). In practice, Zhou et al. (2017)
proposed to use the last activation layer from the trained model by Places dataset as
a generic scene embedding, also termed deep features.
Scene Generation
Scene generation is enabled by a special architecture of DCNN called Generative
Adversarial Nets (GAN) (Goodfellow et al., 2014), which can generate entirely new
predicted images after learning what realistic scenes look like from hundreds of
thousands of real street scenes. GAN creates computer-generated urban scenes
based on user-generated inputs, such as objective characteristics extracted from
images (e.g., buildings, roads, and vehicles) or encoded perceptions (e.g.,
attractiveness, safety, and liveliness of a place). Urban scenes can be also generated
and edited based on some attributes of the built environment (Bau et al., 2020; Zhu
et al., 2020b; Richter et al., 2022). These types of models are useful for scenario
planning and urban design applications which frequently require that participants
10 Handbook of Geospatial Approaches to Sustainable Cities
envision images of cities that don’t exist. Urban designers are also using GAN to
create vivid high-resolution imagery. A pioneering approach looking at this was
introduced by Noyman and Larson (2020), who designed a physical platform that
allows users to generate street scenes by combining a wide range of street elements
based on their preferences, including different land uses, types of roads, density of
buildings, and presence of sidewalks.
Supervised Learning
Supervised learning methods use labeled training data to train a model. In SI urban
physical environment perception, it is possible to use labeled SI (Ye et al., 2020;
Zhu et al., 2020a), point cloud data (Micusik and Kosecka, 2009), or other
annotated datasets, these methods enable the training of models to perform various
FIGURE 1.2 Approaches based on techniques. The supervised learning model utilizes
known street-level imagery along with its corresponding labels during the training phase. The
learning algorithm generates an inference function, which is eventually used to predict
unseen street-level imagery. Unsupervised learning describes hidden structures from
unlabeled data. In the context of street views, it involves learning to partition or classify
street view images into different groups or categories without any prior labels or annotations.
Semi-supervised models use both labeled and unlabeled data for training. Reinforcement
learning is when an agent interacts with an environment to learn and improve its decision-
making. The agent takes action in the environment and receives feedback through rewards or
penalties. The environment represents the system or context in which the agent operates,
providing states and dynamics for interaction. The agent’s goal is to learn the best actions to
maximize cumulative rewards over time in different environmental states.
Urban Sensing with GeoAI and Street‐Level Imagery 11
Unsupervised Learning
Unsupervised learning, including self-supervised learning, is an important approach
to perceiving the urban physical environment using SI. Unlike supervised learning
that relies on labeled data, unsupervised learning methods utilize unlabeled data for
training models and aim to discover hidden structures and patterns in the data
(Wang and Biljecki, 2022). In the context of SI urban physical environment
perception, unsupervised learning methods can be applied to various tasks:
Clustering: Unsupervised learning algorithms can group similar SI features
together based on their intrinsic properties. Clustering can help identify common
patterns or distinct groups within the data, which can be useful for understanding
the diversity of urban environments or discovering specific types of scenes or
objects (Ke et al., 2022).
Dimensionality reduction: Unsupervised learning techniques such as principal
component analysis (PCA) (Yuan et al., 2023) or autoencoders (Kamal and Bae,
2022) can reduce the dimensionality of the street view data while retaining
important information. This can help visualize and analyze the data in a lower-
dimensional space, facilitate data exploration, and improve the efficiency of
subsequent processing tasks.
Anomaly detection: Unsupervised learning methods can identify anomalous or
outlier SIs that deviate from the expected patterns. This can be valuable for
detecting unusual events, identifying infrastructure issues, or discovering
uncommon urban conditions that require further investigation (Zhao et al., 2022).
Representation learning: Unsupervised learning can also be used to learn
meaningful representations or embeddings from unlabeled street view data. By
training models to capture the underlying structure of the data, these representa-
tions can be leveraged for subsequent tasks such as similarity comparison
(Mohamed et al., 2022), retrieval (Lin et al., 2022), or contrastive learning
(Liu et al., 2023).
Semi-Supervised Learning
Semi-Supervised learning methods play a significant role in SI and physical
environment perception by leveraging labeled and unlabeled training data. These
methods can effectively utilize limited labeled data in conjunction with a large
amount of unlabeled data to enhance model performance and generalization
capabilities (Oliveira et al., 2022; Yang et al., 2022). In the context of SI physical
environment perception, semi-supervised learning methods can be applied in
various ways:
Pseudo-labeling: Initially, a small portion of the SI data is manually labeled
with high-quality annotations. These labeled samples are then used to train a
model. The trained model can generate pseudo-labels for the remaining unlabeled
data based on its predictions. The unlabeled data, along with their pseudo-labels,
are then incorporated into the training process to refine the model iteratively
(Li and Ma, 2022).
12 Handbook of Geospatial Approaches to Sustainable Cities
Reinforcement Learning
Reinforcement learning methods learn the optimal behavioral strategy through
the interaction between the agent and the environment. In SI urban physical
environment perception, reinforcement learning methods can be applied to
intelligent navigation, traffic control, and other scenarios to optimize urban
environment perception and decision-making process (Wang et al., 2022b;
Grabaskas and Wang, 2022).
FIGURE 1.3 An overview of the application of urban sensing based on GeoAI and SI.
Based on the depth of urban physical environment sensing, the application can be
hierarchically stratified into three levels. Each sensing level offers a distinct perspective
and an understanding of the urban physical environment. The first level, observational
sensing, primarily centers on the physical entities within urban settings. The second level,
urban implicit relationship sensing, delves into the intangible conceptions that extend beyond
mere physical entities. Lastly, human perception sensing is devoted to capturing and
analyzing human responses and perceptions of the environment.
Urban Sensing with GeoAI and Street‐Level Imagery 13
focuses on the physical entities described in the cities; urban implicit relationship
perception aims to capture the more abstract information hidden in the images, such
as urban socio-economic environments and urban culture; and human perception
sensing emphasizes the emotional experience when urban dwellers participate in the
places and the difference between the objective measure and subjective human
perception.
Instance-Level Sensing
The combined approach of SI and GeoAI is proving invaluable for municipal
engineering by facilitating automated monitoring and streamlining of environmental
audits for various aspects of urban infrastructure (Xiao and Quan, 2009; Kang et al.,
2018). This virtual auditing capability enables efficient analysis and evaluation of
diverse environmental factors, such as urban infrastructure and green spaces, among
other critical elements that contribute to the overall built environment.
One of the key advantages of this approach is the ability to supplement
traditional maps with fine-grained details often overlooked. Through semantic
segmentation of street images, elements such as traffic lights (Campbell et al.,
2019), sideroads (Ning et al., 2022), poles (Ao, 2019; Krylov et al., 2018), traffic
signs (Balali et al., 2015), and zebra crossings (Ahmetovic et al., 2015) can be
accurately identified and incorporated into urban data. This supplementation
enhances GIS and drives the development of three-dimensional GIS and digital
twins (Li and Yao, 2020; Lehtola et al., 2022; Pang and Biljecki, 2022).
Additionally, SIs and GeoAI can be employed to monitor the status of urban
infrastructure to assist with construction and transportation in cities. In this context,
SI serves as a readily accessible data source, enabling numerous studies to extract
relevant information regarding building energy consumption using deep learning
models. These models utilize SIs to infer various factors, including building age
(Sun et al., 2021), window-to-wall ratios (Szczesniak et al., 2022), and image-based
energy efficiency estimation (Mayer et al., 2023). In addition, SIs aid in road quality
monitoring, building damage detection (He et al., 2022), and landslide detection
(Voumard et al., 2017). They also enable the observation of pedestrian and vehicle
flow on roads, providing valuable insights for traffic planning (Chen et al., 2020b;
Yin et al., 2015). The strategic utilization of the extensive data aggregated by SIs
considerably enhances the protection and surveillance of urban construction and
transportation systems and fosters the facilitation of sustainable urban development
(Hak et al., 2016).
14 Handbook of Geospatial Approaches to Sustainable Cities
Street-Level Sensing
Streets, as a vital component of urban morphology, serve as the primary interface
for social interactions between urban residents and the built environment (Li and
Ratti, 2019). The layout of streets has a complex impact on the urban climate,
encompassing factors such as airflow patterns, solar radiation variations, and
precipitation distribution within the city. These factors, in turn, have indirect
consequences for human comfort, ambient air quality, and even the broader climate
cycle (Masson et al., 2020; Shi et al., 2016; Carrasco-Hernandez et al., 2015).
The utilization of SI in combination with GeoAI methods enables the modeling
of key indicators of street metrics, such as sky view factor (SVF) (Xia et al., 2021),
solar radiation (Gong et al., 2019), and light pollution (Li et al., 2021). These
indicators serve a wide range of purposes, ranging from microclimate studies to
guiding urban planning decisions. By utilizing these indicators, cities can optimize
their resource allocation and promote more efficient use of resources. For instance,
Deng et al. (2021) employ semantic segmentation of SIs to assess the potential for
collecting street-level solar radiation, thus offering promising prospects for
improving the efficiency of solar radiation utilization. Furthermore, Li et al.
(2019) utilize image segmentation techniques to detect buildings that may block
sunlight, enabling the prediction of locations prone to sun glare on the streets and
facilitating better guidance for road travel. Due to the important role of greenery in
urban street spaces, a large number of articles focus on the use of GeoAI methods to
generate an indicator to measure urban greenery and its visibility in the city (which
is called green view index, GVI) from SIs (Yang et al., 2009; Li et al., 2015b; Cai
et al., 2018). The impact of urban greenery extends to considerations of thermal
comfort, as green spaces can provide shading and cooling effects, improving the
microclimate and mitigating heat-related issues in urban environments (Li et al.,
2018b). Moreover, the inclusion of green spaces is recognized as an essential
component of sustainable urban development, with studies exploring the relation-
ship between greenery and urban growth, livability, and ecological balance (Chen
et al., 2020a).
The combination of SIs and GeoAI can be effectively integrated into spatial
syntax analysis frameworks (which is a quantitative method for perceiving the
interaction of the urban spatial environment) (Abusaada and Elshater, 2021;
Hidalgo and Hernandez, 2001), either by expanding the scope of investigation
from to objective spatial configuration to subjective urban sensing, or by modeling
key parameters (e.g., enclosure, connectivity, accessibility, visibility) within the
context of space syntax (Jiang et al., 2000; van Nes et al., 2021). Other studies
explore the re-assessment of enclosure (Yin and Wang, 2016), employ isovist
analysis (Takizawa and Kinugawa, 2020; Xiang et al., 2021), and investigate the
relationship between human perception of street accessibility (Wang et al., 2022a)
to further understand the relationship between visual perception and spatial syntax.
The utilization of SIs and GeoAI provides valuable insights for street metrics,
empowering informed decision-making in streets such as urban planning, energy
efficiency, and resource management; and integrating SIs and GeoAI into spatial
syntactic analysis enhances our understanding of the interaction between subjective
Urban Sensing with GeoAI and Street‐Level Imagery 15
Neighborhood-Level Sensing
When we focus our perspective on the neighborhood level, the integration of SI and
GeoAI enables us to observe the harmonious atmosphere in neighborhoods and the
interaction between humans and their surroundings. This capability proves highly
beneficial in the context of public health. Extensive research has consistently
demonstrated a significant relationship between the built environment and the
physical and mental well-being of community residents. Communities that boast
well-maintained surroundings and abundant green spaces tend to foster greater
outdoor activities and promote better mental health among their residents (Barton
and Pretty, 2010). In contrast, communities characterized by disorderly environ-
ments and inadequate infrastructure are often associated with the spread of
epidemics and higher rates of psychological depression among local residents
(Wilson and Kelling, 2015; Sampson and Raudenbush, 1999).
Scientists can employ semantic segmentation techniques to identify various
elements within neighborhoods and evaluate their influence on public health
issues (Rzotkiewicz et al., 2018; Kang et al., 2020; Chen et al., 2023). The
analysis of urban greenery is involved across different scales of urban sensing.
Research at the neighborhood level focuses on the relationship between green
spaces and neighborhood engagement in physical exercise, highlighting the
positive influence of greenery in promoting physical activity and healthy
lifestyles (Ki and Lee, 2021). The mental health benefits of urban green spaces
have also been examined, emphasizing their role in reducing stress, improving
mood, and enhancing overall mental well-being (Soga et al., 2021). Furthermore,
the presence of greenery has been studied in relation to enhanced safety
perceptions and reduced crime rates in neighborhoods (Li et al., 2015a).
Additionally, numerous studies have investigated specific and detailed informa-
tion relevant to public health within neighborhoods, such as the distribution of
retail alcohol stores (Less et al., 2015), the presence of no smoking signs around
schools and hospitals (Wilson and Thomson, 2015), and the evaluation of
community accessibility levels (Seekins et al., 2014). Research in this field also
extends to transportation safety, including the analysis of road traffic accidents
and pedestrian injuries (Johnson and Gabler, 2015; Mooney et al., 2016).
Another prominent area of research in neighborhood-level investigations
revolves around public participation in physical exercises. The integration of SIs
and GeoAI provides a human-centered perspective on the built environment,
thereby highlighting the importance of walkability or bikeability for individuals
(Bartzokas-Tsiompras et al., 2020; Nagata et al., 2020; Chow et al., 2014; Zhou
et al., 2019). SIs and GeoAI also play a crucial role in measuring the physical and
mental health of young and elderly individuals in urban settings (Wang et al., 2019;
Li et al., 2018a). Furthermore, they assist in the detection of environmental factors
associated with healthy or unhealthy lifestyles, such as obesity, alcohol abuse, and
16 Handbook of Geospatial Approaches to Sustainable Cities
diabetes, among residents (Clews et al., 2016; Yang et al., 2020; Egli et al., 2019).
SIs provide valuable insights into the community places frequently visited by
younger and older individuals, shedding light on the development of strategies for
building healthier cities and promoting active lifestyles (Kang et al., 2020).
City-Level Sensing
We can also conduct a comprehensive analysis encompassing the entire city due to
the extensive accessibility of SIs within the urban area. By integrating RS imagery
and SIs, GeoAI methodologies are capable of producing multi-perspective
portrayals of an identical urban physical environment, thereby augmenting the
performance of urban sensing (Najmi et al., 2022; Zou and Wang, 2022). City-level
urban sensing proves invaluable for examining places characterized by “unusual”
conditions on a large scale, which is meaningful for improving the overall quality of
life for urban dwellers and reducing socio-economic disparities. By identifying
urban slums (Najmi et al., 2022; Chen et al., 2022; Fan et al., 2023) and areas with
abundant housing (Zou and Wang, 2022), we can detect the physical segregation
between the affluent and the underprivileged in the city as early as possible,
enabling city managers to proactively address this issue. Moreover, this approach
serves the purpose of uncovering overlooked locales within urban settings (Zhang
et al., 2020a). The identification of so-called “ghost cities” also contributes to
understanding inter-city interactions, which is helpful in guiding broader urban
development strategies (Jin et al., 2017).
By leveraging SIs and GeoAI, we are empowered to assess the vulnerability of
cities in the face of natural disasters, such as flooding and hurricanes (Xing et al.,
2023). The intricate link between the spread of infectious diseases and the
community environment is widely recognized (Perdue et al., 2003). Through
comparing SIs at different time stamps, it is also possible to evaluate the urban
regeneration process (Thackway et al., 2023) and guide the process of post-disaster
recovery (Meyer and Hendricks, 2018). The integration of SIs and GeoAI offers a
synergistic approach enabling environmental monitoring to identify potential
factors contributing to disease transmission. Furthermore, this approach facilitates
the inference of potential transmission trajectories based on the spatial distribution
of infectious disease outbreaks (Nguyen et al., 2020; Delicado and Rowland, 2021;
Haddawy et al., 2019).
The information provided by SIs extends far beyond the visual representation itself.
The application of GeoAI enables us to uncover deeper information pertaining to
the intangible characteristics of cities, including their socio-economic environment,
urban function, and cultural aspects.
Numerous studies have demonstrated the link between the physical environment
and the socio-economic conditions of communities. For instance, neighborhoods
characterized by cleanliness and visual unity often indicate higher socio-economic
status, while areas with higher levels of graffiti and disarray tend to be associated
with poorer socio-economic conditions. By combining SI and GeoAI, we can
Urban Sensing with GeoAI and Street‐Level Imagery 17
environments. This knowledge helps bridge the gap between objective and
subjective perceptions, informing urban planning decisions and interventions to
create safer, more enjoyable, and people-centric cities.
FUTURE TRENDS
We currently reside in an era where sensing is ubiquitous, with people’s approach to
sensing the world expanding rapidly from the utilization of our natural sense organs to
various smart sensing devices. SI effectively broadens the fine-grained urban sensing
methods at the fundamental level of the urban environment. Simultaneously, we find
ourselves amidst an era dominated by the advancements of artificial intelligence (AI),
wherein diverse AI models are employed to accomplish various objectives with
exceptional performance. This newfound efficacy enables human beings to undertake
tasks previously deemed inconceivable. The remarkable achievements attained by
large-sized deep learning models, such as ChatGPT and Segment Anything Model
(SAM), demonstrate the immense potential of AI in accomplishing multipurpose
tasks and analyzing multi-modal data. These models surpass the capabilities of most
pre-existing models, thereby reshaping the research paradigm of deep learning.
Sensor technology and AI systems, distinguished by SI and GeoAI, continue to offer
the profound potential for advancements in every step of urban studies, including the
detecting, handling, and interpreting of urban challenges.
First, the innovation of SIs and GeoAI can provide a more profound and
comprehensible interpretation of the underlying principles behind urban issues.
Future studies should place greater emphasis on examining the augmentation effect
of SIs through the integration of other geospatial data sources, such as social media
and GPS trajectories. By harnessing a diverse range of multi-modal data, we can
expand our urban sensing capabilities and render previously abstract information in
SIs visible. From a public management perspective, it is paramount to understand
the rationale behind AI-based decision-making rather than solely focusing on the
outcomes. Incorporating interpretable AI techniques enables effective analysis of
the reasoning behind the approaches taken by AI models in addressing urban
problems, as well as understanding the disparities between AI and human policy-
making. Consequently, this fosters policymakers’ awareness of previously over-
looked phenomena.
Furthermore, harnessing the power of SI and GeoAI offers a wide array of
diverse and precise methodologies to enrich urban studies. Artificial Intelligence-
Generated Content (AIGC) empowers us to generate practical solutions tailored to
address specific problems in a variety of scenarios. Moreover, it facilitates the
creation of urban designs that are customized to align with the expectations and
objectives of urban development set forth by governments or policymakers. By
leveraging SI and GeoAI, we can introduce a range of alternative approaches to
urban planning and design processes, thereby yielding more targeted and effective
solutions for the challenges faced in urban development.
Finally, the promising prospect of artificial general intelligence (AGI), which
possesses heightened intelligence and extraordinary information-gathering capabil-
ities, holds the potential to serve as a powerful agent for the autonomous
20 Handbook of Geospatial Approaches to Sustainable Cities
REFERENCES
Abusaada, H. and Elshater, A. (2021). Effect of people on placemaking and affective
atmospheres in city streets. Ain Shams Engineering Journal, 12(3):3389–3403.
Ahmetovic, D., Manduchi, R., Coughlan, J. M., and Mascetti, S. (2015). Zebra crossing
spotter: Automatic population of spatial databases for increased safety of blind
travelers. In Proceedings of the 17th International ACM SIGACCESS Conference
on Computers & Accessibility, pages 251–258.
Alqurashi, A. and Kumar, L. (2013). Investigating the use of remote sensing and GIS
techniques to detect land use and land cover change: A review. Advances in Remote
Sensing, 2: 193–204.
Anguelov, D., Dulong, C., Filip, D., Frueh, C., Lafon, S., Lyon, R., Ogale, A., Vincent, L.,
and Weaver, J. (2010). Google street view: Capturing the world at street level.
Computer, 43(6):32–38.
Ao, Y. (2019). Fully Convolutional Networks for Street Furniture Identification in Panorama
Images. Master’s thesis, University of Twente.
Arietta, S. M., Efros, A. A., Ramamoorthi, R., and Agrawala, M. (2014). City forensics:
Using visual elements to predict non-visual city attributes. IEEE Transactions on
Visualization and Computer Graphics, 20(12):2624–2633.
Balali, V., Ashouri Rad, A., and Golparvar-Fard, M. (2015). Detection, classification, and
mapping of US traffic signs using Google street view images for roadway inventory
management. Visualization in Engineering, 3:1–18.
Barton, J. and Pretty, J. (2010). What is the best dose of nature and green exercise
for improving mental health? a multi-study analysis. Environmental Science &
Technology, 44(10):3947–3955.
Bartzokas-Tsiompras, A., Tampouraki, E. M., and Photis, Y. N. (2020). Is walkability
equally distributed among downtowners? evaluating the pedestrian streetscapes of
eight European capitals using a micro-scale audit approach. City Sustainability and
Regeneration, 4, page 135.
Bau, D., Zhu, J.-Y., Strobelt, H., Lapedriza, A., Zhou, B., and Torralba, A. (2020).
Understanding the role of individual units in a deep neural network. Proceedings of the
National Academy of Sciences, 117(48):30071–30078.
Biljecki, F. and Ito, K. (2021). Street view imagery in urban analytics and GIS: A review.
Landscape and Urban Planning, 215:104217.
Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y. M. (2020). Yolov4: Optimal speed and
accuracy of object detection. arXiv preprint arXiv:2004.10934.
Bortoloti, F. D., Tavares, J., Rauber, T. W., Ciarelli, P. M., and Botelho, R. C. G. (2022). An
annotated image database of building facades categorized into land uses for object
Urban Sensing with GeoAI and Street‐Level Imagery 21
detection using deep learning: Case study for the city of Vila Velha-ES, Brazil.
Machine Vision and Applications, 33(5):80.
Cai, B. Y., Li, X., Seiferling, I., and Ratti, C. (2018). Treepedia 2.0: applying deep learning
for large-scale quantification of urban tree cover. In 2018 IEEE International Congress
on Big Data, pages 49–56. IEEE.
Campbell, A., Both, A., and Sun, Q. C. (2019). Detecting and mapping traffic signs from
Google street view images using deep learning and GIS. Computers, Environment and
Urban Systems, 77:101350.
Cao, R., Zhu, J., Tu, W., Li, Q., Cao, J., Liu, B., Zhang, Q., and Qiu, G. (2018). Integrating
aerial and street view images for urban land use classification. Remote Sensing,
10(10):1553.
Carrasco-Hernandez, R., Smedley, A. R., and Webb, A. R. (2015). Using urban canyon
geometries obtained from Google street view for atmospheric studies: Potential
applications in the calculation of street level total shortwave irradiances. Energy and
Buildings, 86:340–348.
Chen, B., Feng, Q., Niu, B., Yan, F., Gao, B., Yang, J., Gong, J., and Liu, J. (2022).
Multimodal fusion of satellite and street-view images for urban village classification
based on a dual-branch deep neural network. International Journal of Applied Earth
Observation and Geoinformation, 109:102794.
Chen, J., Chen, L., Li, Y., Zhang, W., and Long, Y. (2023). Measuring physical disorder in
urban street spaces: A large-scale analysis using street view images and deep learning.
Annals of the American Association of Geographers, 113(2):469–487.
Chen, J., Zhou, C., and Li, F. (2020a). Quantifying the green view indicator for assessing
urban greening quality: An analysis based on internet-crawling street view data.
Ecological Indicators, 113:106192.
Chen, L., Lu, Y., Sheng, Q., Ye, Y., Wang, R., and Liu, Y. (2020b). Estimating pedestrian
volume using street view images: A large-scale validation test. Computers,
Environment and Urban Systems, 81:101481.
Choi, K., Lim, W., Chang, B., Jeong, J., Kim, I., Park, C.-R., and Ko, D. W. (2022). An
automatic approach for tree species detection and profile estimation of urban street
trees using deep learning and Google street view images. ISPRS Journal of
Photogrammetry and Remote Sensing, 190:165–180.
Chow, C. K., Corsi, D. J., Lock, K., Madhavan, M., Mackie, P., Li, W., Yi, S., Wang, Y.,
Swaminathan, S., Lopez-Jaramillo, P., et al. (2014). A novel method to evaluate
the community built environment using photographs–environmental profile of a
community health (epoch) photo neighbourhood evaluation tool. PLoS One, 9(11):
e110042.
Clews, C., Brajkovich-Payne, R., Dwight, E., Ahmad Fauzul, A., Burton, M., Carleton, O.,
Cook, J., Deroles, C., Faulkner, R., Furniss, M., et al. (2016). Alcohol in urban
streetscapes: A comparison of the use of Google street view and on-street observation.
BMC Public Health, 16:1–8.
Davison, K. K. and Lawson, C. T. (2006). Do attributes in the physical environment
influence children’s physical activity? A review of the literature. International Journal
of Behavioral Nutrition and Physical Activity, 3(1):1–17.
Delicado, A. and Rowland, J. (2021). Visual representations of science in a pandemic: Covid-
19 in images. Frontiers in Communication, 6:645725.
DeMers, M. N. (2008). Fundamentals of Geographic Information Systems. John Wiley &
Sons.
Deng, M., Yang, W., Chen, C., Wu, Z., Liu, Y., and Xiang, C. (2021). Street-level solar
radiation mapping and patterns profiling using Baidu street view images. Sustainable
Cities and Society, 75:103289.
22 Handbook of Geospatial Approaches to Sustainable Cities
Dubey, A., Naik, N., Parikh, D., Raskar, R., and Hidalgo, C. A. (2016a). Deep learning the
city: Quantifying urban perception at a global scale, In Computer Vision–ECCV 2016:
14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016,
Proceedings, Part I 14 (pp. 196–212).
Dubey, A., Naik, N., Parikh, D., Raskar, R., and Hidalgo, C. A. (2016b). Deep learning the
city: Quantifying urban perception at a global scale. In Computer Vision–ECCV 2016:
14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016,
Proceedings, Part I 14, pages 196–212. Springer.
Dutta, P., Aoki, P. M., Kumar, N., Mainwaring, A., Myers, C., Willett, W., and Woodruff, A.
(2009). Common sense: Participatory urban sensing using a network of handheld air
quality monitors. In Proceedings of the 7th ACM Conference on Embedded Networked
Sensor Systems, pages 349–350.
Egli, V., Zinn, C., Mackay, L., Donnellan, N., Villanueva, K., Mavoa, S., Exeter, D. J.,
Vandevijvere, S., and Smith, M. (2019). Viewing obesogenic advertising in
children’s neighbourhoods using Google street view. Geographical Research, 57(1):
84–97.
Fan, M., Huang, J., and Wang, H. (2022). Dumapper: Towards automatic verification
of largescale pois with street views at Baidu maps. In Proceedings of the 31st
ACM International Conference on Information & Knowledge Management, pages
3063–3071.
Fan, Z., Su, T., Sun, M., Noyman, A., Zhang, F., Pentland, A. S., and Moro, E. (2023).
Diversity beyond density: Experienced social mixing of urban streets. PNAS Nexus,
2(4): PNAS Nexus, 2023, 1–11.
Fang, F., Yu, Y., Li, S., Zuo, Z., Liu, Y., Wan, B., and Luo, Z. (2021). Synthesizing location
semantics from street view images to improve urban land-use classification.
International Journal of Geographical Information Science, 35(9):1802–1825.
Fleischhacker, S. E., Evenson, K. R., Sharkey, J., Pitts, S. B. J., and Rodriguez, D. A. (2013).
Validity of secondary retail food outlet data: A systematic review. American Journal of
Preventive Medicine, 45(4):462–473.
Frank, L. D., Schmid, T. L., Sallis, J. F., Chapman, J., and Saelens, B. E. (2005). Linking
objectively measured physical activity with objectively measured urban form: Findings
from smartraq. American Journal of Preventive Medicine, 28(2):117–125.
Galea, S., Ahern, J., Rudenstine, S., Wallace, Z., and Vlahov, D. (2005). Urban built
environment and depression: A multilevel analysis. Journal of Epidemiology &
Community Health, 59(10):822–827.
Gao, S., Yang, K., Shi, H., Wang, K., and Bai, J. (2022). Review on panoramic imaging and
its applications in scene understanding. IEEE Transactions on Instrumentation and
Measurement, 71:1–34.
Gebru, T., Krause, J., Wang, Y., Chen, D., Deng, J., Aiden, E. L., and Fei-Fei, L. (2017).
Using deep learning and Google street view to estimate the demographic makeup
of neighborhoods across the United States. Proceedings of the National Academy of
Sciences, 114(50):13108–13113.
Gehl, J. (2013). Cities for People. Island Press.
Gong, F.-Y., Zeng, Z.-C., Ng, E., and Norford, L. K. (2019). Spatiotemporal patterns of
streetlevel solar radiation estimated using Google street view in a high-density urban
environment. Building and Environment, 148:547–566.
Gong, F.-Y., Zeng, Z.-C., Zhang, F., Li, X., Ng, E., and Norford, L. K. (2018). Mapping sky,
tree, and building view factors of street canyons in a high-density urban environment.
Building and Environment, 134:155–167.
Goodchild, M. F. (2007). Citizens as sensors: The world of volunteered geography.
GeoJournal, 69(4):211–221.
Urban Sensing with GeoAI and Street‐Level Imagery 23
Jin, X., Long, Y., Sun, W., Lu, Y., Yang, X., and Tang, J. (2017). Evaluating cities’ vitality
and identifying ghost cities in China with emerging geographical data. Cities,
63:98–109.
Johnson, J. (2019). Jumping into the world of virtual and augmented reality. Knowledge
Quest, 47(4):22–27.
Johnson, N. S. and Gabler, H. C. (2015). Injury outcome in crashes with guardrail end
terminals. Traffic Injury Prevention, 16(sup2):S103–S108.
Juhasz, L. and Hochmair, H. H. (2016). User contribution patterns and completeness
evaluation of Mapillary, a crowdsourced street level photo service. Transactions in
GIS, 20(6):925–947.
Kamal, I. M. and Bae, H. (2022). Super-encoder with cooperative autoencoder networks.
Pattern Recognition, 126:108562.
Kamran, S. and Haas, O. (2007). A multilevel traffic incidents detection approach:
Identifying traffic patterns and vehicle behaviours using real-time GPS data. In 2007
IEEE Intelligent Vehicles Symposium, pages 912–917.
Kang, J., Korner, M., Wang, Y., Taubenb¨ ock, H., and Zhu, X. X. (2018). Building instance
classification using street view images. ISPRS Journal of Photogrammetry and Remote
Sensing, 145:44–59.
Kang, Y., Abraham, J., Ceccato, V., Duarte, F., Gao, S., Ljungqvist, L., Zhang, F., Nasman,
P., and Ratti, C. (2023). Assessing differences in safety perceptions using GeoAI and
survey across neighbourhoods in Stockholm, Sweden. Landscape and Urban Planning,
236:104768.
Kang, Y., Zhang, F., Gao, S., Lin, H., and Liu, Y. (2020). A review of urban physical
environment sensing using street view imagery in public health studies. Annals of GIS,
26(3):261–275.
Kang, Y., Zhang, F., Peng, W., Gao, S., Rao, J., Duarte, F., and Ratti, C. (2021).
Understanding house price appreciation using multi-source big geo-data and machine
learning. Land Use Policy, 111:104919.
Ke, T.-W., Hwang, J.-J., Guo, Y., Wang, X., and Yu, S. X. (2022). Unsupervised hierarchical
semantic segmentation with multiview cosegmentation and clustering transformers.
In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern
Recognition, pages 2571–2581.
Khorshidi, S., Carter, J., Mohler, G., and Tita, G. (2021). Explaining crime diversity with
Google street view. Journal of Quantitative Criminology, 37:361–391.
Khosla, A., An An, B., Lim, J. J., and Torralba, A. (2014). Looking beyond the visible scene.
In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition,
pages 3710–3717.
Ki, D. and Lee, S. (2021). Analyzing the effects of green view index of neighborhood streets
on walking time using Google street view and deep learning. Landscape and Urban
Planning, 205:103920.
Kostakos, P., Alavesa, P., Oppenlaender, J., and Hosio, S. (2019). Vr ethnography: a pilot
study on the use of virtual reality ’go-along’ interviews in Google street view. In
Proceedings of the 18th International Conference on Mobile and Ubiquitous
Multimedia, pages 1–5.
Krylov, V. A., Kenny, E., and Dahyot, R. (2018). Automatic discovery and geotagging of
objects from street view imagery. Remote Sensing, 10(5):661.
Lander, C., Wiehr, F., Herbig, N., Kruger, A., and L¨ ochtefeld, M. (2017). Inferring
landmarks¨ for pedestrian navigation from mobile eye-tracking data and Google street
view. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human
Factors in Computing Systems, pages 2721–2729.
Lauko, I. G., Honts, A., Beihoff, J., and Rupprecht, S. (2020). Local color and morphological
image feature based vegetation identification and its application to human environment
Urban Sensing with GeoAI and Street‐Level Imagery 25
street view vegetation mapping, or how green is our county? Geo-spatial Information
Science, 23(3):222–236.
Law, S., Paige, B., and Russell, C. (2019). Take a look around: using street view and satellite
images to estimate house prices. ACM Transactions on Intelligent Systems and
Technology, 10(5):1–19.
Lehtola, V. V., Koeva, M., Elberink, S. O., Raposo, P., Virtanen, J.-P., Vahdatikhaki, F.,
and Borsci, S. (2022). Digital twin of a city: Review of technology serving city
needs. International Journal of Applied Earth Observation and Geoinformation,
page 102915.
Less, E. L., McKee, P., Toomey, T., Nelson, T., Erickson, D., Xiong, S., and Jones-Webb, R.
(2015). Matching study areas using Google street view: A new application for an
emerging technology. Evaluation and Program Planning, 53:72–79.
Li, D., Deal, B., Zhou, X., Slavenas, M., and Sullivan, W. C. (2018a). Moving beyond the
neighborhood: Daily exposure to nature and adolescents’ mood. Landscape and Urban
Planning, 173:33–43.
Li, M. and Yao, W. (2020). 3D map system for tree monitoring in Hong Kong using Google
street view imagery and deep learning. ISPRS Annals of the Photogrammetry, Remote
Sensing and Spatial Information Sciences, 3:765–772.
Li, X., Cai, B. Y., Qiu, W., Zhao, J., and Ratti, C. (2019). A novel method for predicting and
mapping the occurrence of sun glare using Google street view. Transportation
Research Part C: Emerging Technologies, 106:132–144.
Li, X., Duarte, F., and Ratti, C. (2021). Analyzing the obstruction effects of obstacles on light
pollution caused by street lighting system in Cambridge, Massachusetts. Environment
and Planning B: Urban Analytics and City Science, 48(2):216–230.
Li, X. and Ratti, C. (2019). Using Google street view for street-level urban form analysis, a
case study in Cambridge, Massachusetts. The Mathematics of Urban Morphology,
5:457–470.
Li, X., Ratti, C., and Seiferling, I. (2018b). Quantifying the shade provision of street trees in
urban landscape: A case study in Boston, USA, using Google street view. Landscape
and Urban Planning, 169:81–91.
Li, X., Zhang, C., and Li, W. (2015a). Does the visibility of greenery increase perceived
safety in urban areas? evidence from the place pulse 1.0 dataset. ISPRS International
Journal of Geo-Information, 4(3):1166–1183.
Li, X., Zhang, C., Li, W., Ricard, R., Meng, Q., and Zhang, W. (2015b). Assessing street-
level urban greenery using Google street view and a modified green view index. Urban
Forestry & Urban Greening, 14(3):675–685.
Li, Z. and Ma, J. (2022). Discussing street tree planning based on pedestrian volume
using machine learning and computer vision. Building and Environment, 219:
109178.
Liang, B. and Weng, Q. (2010). Assessing urban environmental quality change of
Indianapolis, United States, by the remote sensing and GIS integration. IEEE
Journal of Selected Topics in Applied Earth Observations and Remote Sensing,
4(1):43–55.
Liang, C., Serge, A., Zhang, X., Wang, H., and Wang, W. (2023). Assessment of street forest
characteristics in four African cities using Google street view measurement: Potentials
and implications. Environmental Research, 221:115261.
Lin, J., Zheng, Z., Zhong, Z., Luo, Z., Li, S., Yang, Y., and Sebe, N. (2022). Joint
representation learning and keypoint detection for cross-view geo-localization. IEEE
Transactions on Image Processing, 31:3780–3792.
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A. C. (2016).
SSD: Single shot multibox detector. In European Conference on Computer Vision,
pages 21–37.
26 Handbook of Geospatial Approaches to Sustainable Cities
Liu, Y., Zhang, X., Ding, J., Xi, Y., and Li, Y. (2023). Knowledge-infused contrastive
learning for urban imagery-based socioeconomic prediction. In Proceedings of the
ACM Web Conference 2023, pages 4150–4160.
Lynch, K. (1964). The Image of the City. MIT Press.
Masson, V., Lemonsu, A., Hidalgo, J., and Voogt, J. (2020). Urban climates and climate
change. Annual Review of Environment and Resources, 45:411–444.
Mayer, K., Haas, L., Huang, T., Bernabe-Moreno, J., Rajagopal, R., and Fischer, M. (2023).
Estimating building energy efficiency from street view imagery, aerial imagery, and
land surface temperature data. Applied Energy, 333:120542.
Meyer, M. A. and Hendricks, M. D. (2018). Using photography to assess housing damage
and rebuilding progress for disaster recovery planning. Journal of the American
Planning Association, 84(2):127–144.
Micusik, B. and Kosecka, J. (2009). Piecewise planar city 3D modeling from street view
panoramic sequences. In Proceedings of the IEEE Conference on Computer Vision and
Pattern Recognition.
Miller, R. B. and Small, C. (2003). Cities from space: potential applications of remote
sensing in urban environmental research and policy. Environmental Science & Policy,
6(2):129–137.
Mohamed, A., Lee, H.-y., Borgholt, L., Havtorn, J. D., Edin, J., Igel, C., Kirchhoff, K., Li, S.-
W., Livescu, K., Maaløe, L., et al. (2022). Self-supervised speech representation
learning: A review. IEEE Journal of Selected Topics in Signal Processing, 16,
1179–1210.
Mooney, S. J., DiMaggio, C. J., Lovasi, G. S., Neckerman, K. M., Bader, M. D., Teitler, J.
O., Sheehan, D. M., Jack, D. W., and Rundle, A. G. (2016). Use of Google street view
to assess environmental contributions to pedestrian injury. American Journal of Public
Health, 106(3):462–469.
Nagata, S., Nakaya, T., Hanibuchi, T., Amagasa, S., Kikuchi, H., and Inoue, S. (2020).
Objective scoring of streetscape walkability related to leisure walking: Statistical
modeling approach with semantic segmentation of Google street view images. Health
& Place, 66:102428.
Naik, N., Kominers, S. D., Raskar, R., Glaeser, E. L., and Hidalgo, C. A. (2017). Computer
vision uncovers predictors of physical urban change. Proceedings of the National
Academy of Sciences, 114(29):7571–7576.
Naik, N., Philipoom, J., Raskar, R., and Hidalgo, C. (2014). Streetscore-predicting the
perceived safety of one million streetscapes In Proceedings of the IEEE Conference on
Computer Vision and Pattern Recognition Workshops. 779–785.
Najmi, A., Gevaert, C. M., Kohli, D., Kuffer, M., and Pratomo, J. (2022). Integrating remote
sensing and street view imagery for mapping slums. ISPRS International Journal of
GeoInformation, 11(12):631.
Nguyen, Q. C., Huang, Y., Kumar, A., Duan, H., Keralis, J. M., Dwivedi, P.,
Meng, H.-W., Brunisholz, K. D., Jay, J., Javanmardi, M., et al. (2020). Using
164 million Google street view images to derive built environment predictors of
covid-19 cases. International Journal of Environmental Research and Public
Health, 17(17):6359.
Ning, H., Ye, X., Chen, Z., Liu, T., and Cao, T. (2022). Sidewalk extraction using aerial and
street view images. Environment and Planning B: Urban Analytics and City Science,
49(1):7–22.
Noyman, A. and Larson, K. (2020). A deep image of the city: Generative urban-design
visualization. Challenge, 7:30.
Oliveira, A. A. A., Wang, Z., and Hirata, R. (2022). Locating urban trees near electric wires
using Google street view photos: A new dataset and a semi-supervised learning
Urban Sensing with GeoAI and Street‐Level Imagery 27
Van der Spek, S., Van Schaick, J., De Bois, P., and De Haan, R. (2009). Sensing human
activity: GPS tracking. Sensors, 9(4):3033–3055.
van Nes, A., Yamu, C., van Nes, A., and Yamu, C. (2021). Space syntax applied in urban
practice. Introduction to Space Syntax in Urban Studies, pages 213–237.
Verma, D., Jana, A., and Ramamritham, K. (2020). Predicting human perception of the urban
environment in a spatiotemporal urban setting using locally acquired street view
images and audio clips. Building and Environment, 186:107340.
Vo, A. V., Bertolotto, M., Ofterdinger, U., and Laefer, D. F. (2023). In search of basement
indicators from street view imagery data: An investigation of data sources and analysis
strategies. KI-Künstliche Intelligenz, pages 1–13.
Voumard, J., Abellan, A., Nicolet, P., Penna, I., Chanut, M.-A., Derron, M.-H., and Jaboyedo
ff, M. (2017). Using street view imagery for 3-d survey of rock slope failures. Natural
Hazards and Earth System Sciences, 17(12):2093–2107.
Wang, B., Xu, T., Gao, H., Ta, N., Chai, Y., and Wu, J. (2021a). Can daily mobility alleviate
green inequality from living and working environments? Landscape and Urban
Planning, 214:104179.
Wang, J. and Biljecki, F. (2022). Unsupervised machine learning in urban studies: A
Systematic Review of Applications. Cities, 129:103925.
Wang, J., Sun, K., Cheng, T., Jiang, B., Deng, C., Zhao, Y., Liu, D., Mu, Y., Tan, M., Wang,
X., et al. (2020). Deep high-resolution representation learning for visual recognition.
IEEE Transactions on Pattern Analysis and Machine Intelligence, 43:3349–3364.
Wang, L., Han, X., He, J., and Jung, T. (2022a). Measuring residents’ perceptions of city
streets to inform better street planning through deep learning and space syntax.
ISPRS Journal of Photogrammetry and Remote Sensing, 190:215–230.
Wang, R., Feng, Z., Pearce, J., Yao, Y., Li, X., and Liu, Y. (2021b). The distribution of
greenspace quantity and quality and their association with neighbourhood socio-
economic conditions in Guangzhou, China: A new approach using deep learning
method and street view images. Sustainable Cities and Society, 66:102664.
Wang, R., Lu, Y., Zhang, J., Liu, P., Yao, Y., and Liu, Y. (2019). The relationship between
visual enclosure for neighbourhood street walkability and elders’ mental health in
China: Using street view images. Journal of Transport & Health, 13:90–102.
Wang, Y., Zeng, Z., Li, Q., and Deng, Y. (2022b). A complete reinforcement-learning-based
framework for urban-safety perception. ISPRS International Journal of Geo-
Information, 11(9):465.
Whyte, W. H. et al. (1980). The Social Life of Small Urban Spaces. Conservation Foundation
Washington, DC.
Wilson, J. Q. and Kelling, G. L. (2015). Broken windows. Routledge.
Wilson, N. and Thomson, G. (2015). Suboptimal smokefree signage at some hospitals: field
observations and the use of google street view. The New Zealand Medical Journal,
128(1415):56.
Wilson, W. H. (1989). The City Beautiful Movement. Johns Hopkins University Press
Baltimore.
Xia, Y., Yabuki, N., and Fukuda, T. (2021). Sky view factor estimation from street view
images based on semantic segmentation. Urban Climate, 40:100999.
Xiang, L., Cai, M., Ren, C., and Ng, E. (2021). Modeling pedestrian emotion in high-density
cities using visual exposure and machine learning: Tracking real-time physiology and
psychology in Hong Kong. Building and Environment, 205:108273.
Xiao, J. and Quan, L. (2009). Multiple view semantic segmentation for street view images.
In 2009 IEEE 12th International Conference on Computer Vision, pages 686–693.
IEEE.
Xie, Y., Sha, Z., and Yu, M. (2008). Remote sensing imagery in vegetation mapping: a
review. Journal of Plant Ecology, 1(1):9–23.
Urban Sensing with GeoAI and Street‐Level Imagery 29
Xing, Z., Yang, S., Zan, X., Dong, X., Yao, Y., Liu, Z., and Zhang, X. (2023).
Flood vulnerability assessment of urban buildings based on integrating high-
resolution remote sensing and street view images. Sustainable Cities and Society,
92:104467.
Yan, Y., Feng, C.-C., Huang, W., Fan, H., Wang, Y.-C., and Zipf, A. (2020). Volunteered
geographic information research in the first decade: A narrative review of selected
journal articles in GIScience. International Journal of Geographical Information
Science, 34(9):1765–1791.
Yang, J., Zhao, L., Mcbride, J., and Gong, P. (2009). Can you see green? assessing the
visibility of urban forests in cities. Landscape and Urban Planning, 91(2):97–104.
Yang, X., Song, Z., King, I., and Xu, Z. (2022). A survey on deep semi-supervised learning.
IEEE Transactions on Knowledge and Data Engineering, 35:8934–8954.
Yang, Y., Lu, Y., Yang, L., Gou, Z., and Zhang, X. (2020). Urban greenery, active school
transport, and body weight among Hong Kong children. Travel Behaviour and Society,
20:104–113.
Yao, Y., Zhang, J., Qian, C., Wang, Y., Ren, S., Yuan, Z., and Guan, Q. (2021). Delineating
urban job-housing patterns at a parcel scale with street view imagery. International
Journal of Geographical Information Science, 35(10):1927–1950.
Ye, C., Zhang, F., Mu, L., Gao, Y., and Liu, Y. (2020). Urban function recognition by
integrating social media and street-level imagery. Environment and Planning B: Urban
Analytics and City Science.
Ye, C., Zhang, F., Mu, L., Gao, Y., and Liu, Y. (2021). Urban function recognition by
integrating social media and street-level imagery. Environment and Planning B: Urban
Analytics and City Science, 48(6):1430–1444.
Ye, Y., Zeng, W., Shen, Q., Zhang, X., and Lu, Y. (2019). The visual quality of streets: A
human-centred continuous measurement based on machine learning algorithms and
street view images. Environment and Planning B: Urban Analytics and City Science,
46(8):1439– 1457.
Yin, L., Cheng, Q., Wang, Z., and Shao, Z. (2015). ‘Big data’ for pedestrian volume:
Exploring the use of Google street view images for pedestrian counts. Applied
Geography, 63:337–345.
Yin, L. and Wang, Z. (2016). Measuring visual enclosure for street walkability: Using
machine learning algorithms and Google street view imagery. Applied Geography,
76:147–153.
Yu, X., Her, Y., Huo, W., Chen, G., and Qi, W. (2022). Spatio-temporal monitoring of
urban street-side vegetation greenery using Baidu street view images. Urban Forestry
& Urban Greening, 73:127617.
Yuan, Y., Wang, R., Niu, T., and Liu, Y. (2023). Using street view images and
a geographical detector to understand how street-level built environment is
associated with urban poverty: A case study in Guangzhou. Applied Geography,
156:102980.
Zhang, A., Song, L., and Zhang, F. (2022). Perception of pleasure in the urban running
environment with street view images and running routes. Journal of Geographical
Sciences, 32(12):2624–2640.
Zhang, F., Fan, Z., Kang, Y., Hu, Y., and Ratti, C. (2021). “Perception bias”: Deciphering a
mismatch between urban crime and perception of safety. Landscape and Urban
Planning, 207:104003.
Zhang, F., Mirandaa, A. S., Duarte, F., Vale, L., Hack, G., Liu, Y., Batty, M., and Ratti, C.
(2023a). Urban visual intelligence: Studying cities with AI and street-level imagery.
Annals of the American Association of Geographers, 114(2):1–18.
Zhang, F., Wegner, J. D., Yang, B., and Liu, Y. (2023b). Street-level imagery analytics and
applications. ISPRS Journal of Photogrammetry and Remote Sensing, 199:195–196.
Random documents with unrelated
content Scribd suggests to you:
—Adieu, mon chéri ... Et à toi, si tu veux, quand tu voudras!...
Adieu!
La porte claqua au loin. C'était fini.
Mareuil alluma une cigarette et descendit sans se presser. Il se
sentait un peu ahuri et tamponnait machinalement ses paupières
brûlantes.
Sous la voûte, Mme Honoré la concierge courut après lui:
—Est-ce que Monsieur vient demain? Dois-je préparer du feu?
Il n'eut pas l'humilité de dire non, et d'un ton sec il répondit:
—Je ne sais pas, préparez toujours!
Puis il s'en alla rapidement, car Mme Honoré fixait, avec une
persistance curieuse, ses yeux gonflés d'avoir pleuré.
IV
Le soir même, chez les Brévannes, il y avait dîner intime, toute la
bande conviée.
Dès son arrivée, Mareuil prit Brévannes à part et lui conta l'entrevue
de l'après-midi.
Le journaliste souriait, approuvait par instants:
—Bravo! Très bien!
Il conclut:
—Eh bien, tout cela me semble parfait ... Je suppose que
maintenant vous allez vous tenir tranquille ...
Henriette, que ce colloque intriguait et qui avait entendu les derniers
mots, jugea bon d'intervenir:
—Quoi donc?... Qu'est-ce qui est parfait?
Et s'adressant à Mareuil, avec un air de compassion:
—Encore des ennuis, mon pauvre Soif-d'Amour?
Elle se tut, ayant remarqué que Brévannes la guettait d'un œil
courroucé.
—Ma jeune enfant, lui dit-il, je vous dispense, à l'avenir, d'appeler
Mareuil de ce nom ridicule ... Un jour il se fâchera, et je vous jure
bien que ce n'est pas moi qui lui donnerai tort!...
Henriette, interdite par cette réprimande, si contraire aux usages
constants de la maison, essaya, par contenance, de la puérilité:
—Est-ce qu'on m'avait dit, à moi?... Faut pas me gronder, moi!
La tentative échoua misérablement.
—Voyons, tu sais bien que j'ai horreur de ces manières-là, bougonna
Brévannes ... Occupe-toi donc plutôt du dîner!...
Les autres s'étaient à peine dérangés durant cette courte altercation.
Labernerie, qui avait hargneusement levé la tête de dessus son
journal, reprit sa lecture. Le Grand-Cob referma l'œil qu'il s'était
efforcé d'entr'ouvrir, malgré la somnolence qui lui restait d'une nuit
passée, la veille, dans les cabarets des Halles. Charleval paraissait
emporté dans des conceptions ... Ce Mareuil, encore! Ses affaires de
cœur! Sa dame du monde! Et ils songeaient qu'il était bien gentil,
Mareuil, mais tout de même un peu raseur, quelquefois, avec ses
histoires de femmes!
ebookbell.com