SideSeeing: A multimodal dataset and collection of tools for sidewalk assessment
This paper introduces SideSeeing, a novel initiative that provides tools and datasets for assessing the built environment. We present a framework for street-level data acquisition, loading, and analysis. Using the framework, we collected a novel dataset that integrates synchronized video footaged captured from chest-mounted mobile devices with sensor data (accelerometer, gyroscope, magnetometer, and GPS). Each data sample represents a path traversed by a user filming sidewalks near hospitals in Brazil and the USA. The dataset encompasses three hours of content covering 12 kilometers around nine hospitals, and includes 325,000 video frames with corresponding sensor data. Additionally, we present a novel 68-element taxonomy specifically created for sidewalk scene identification. SideSeeing is a step towards a suite of tools that urban experts can use to perform in-depth sidewalk accessibility evaluations. SideSeeing data and tools are publicly available at https://sites.usp.br/sideseeing/.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
iOSPointMapper: RealTime Pedestrian and Accessibility Mapping with Mobile AI
Accurate, up-to-date sidewalk data is essential for building accessible and inclusive pedestrian infrastructure, yet current approaches to data collection are often costly, fragmented, and difficult to scale. We introduc…
Semantic SegmentationDepth EstimationTowards Global-Scale Crowd+AI Techniques to Map and Assess Sidewalks for People with Disabilities
There is a lack of data on the location, condition, and accessibility of sidewalks across the world, which not only impacts where and how people travel but also fundamentally limits interactive mapping tools and urban an…
Active LearningSemantic SegmentationLeveraging Sidewalk Robots for Walkability-Related Analyses
Walkability is a key component of sustainable urban development. In walkability studies, collecting detailed pedestrian infrastructure data remains challenging due to the high costs and limited scalability of traditional…
From Imitation to Alignment: Human-Preference Flow Policies for Long-Horizon Sidewalk Navigation
Autonomous long-horizon sidewalk navigation is essential for micro-mobility applications such as robotic food delivery and assistive electronic wheelchairs. Unlike autonomous driving on the road, long-horizon sidewalk na…
Autonomous DrivingSafety-oriented sidewalk and road segmentation for smartphone-based assistive navigation
Independent sidewalk mobility is essential for blind and visually impaired pedestrians (BVIPs), yet smartphone-based assistive navigation requires perception models that distinguish walkable sidewalks from adjacent unsaf…
Semantic SegmentationDomain AdaptationRoad Segmentation