A Supervised Machine Learning Model For Imputing Missing Boarding Stops In Smart Card Data

2020-03-10 · Nadav Shalit, Michael Fire, Eran Ben-Elia

Public transport has become an essential part of urban existence with increased population densities and environmental awareness. Large quantities of data are currently generated, allowing for more robust methods to understand travel behavior by harvesting smart card usage. However, public transport datasets suffer from data integrity problems; boarding stop information may be missing due to imperfect acquirement processes or inadequate reporting. We developed a supervised machine learning method to impute missing boarding stops based on ordinal classification using GTFS timetable, smart card, and geospatial datasets. A new metric, Pareto Accuracy, is suggested to evaluate algorithms where classes have an ordinal nature. Results are based on a case study in the city of Beer Sheva, Israel, consisting of one month of smart card data. We show that our proposed method is robust to irregular travelers and significantly outperforms well-known imputation methods without the need to mine any additional datasets. Validation of data from another Israeli city using transfer learning shows the presented model is general and context-free. The implications for transportation planning and travel behavior research are further discussed.

📄 PDF Abstract BibTeX arXiv:2003.05285

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine Learning Imputation Ordinal Classification Transfer Learning

Missing Data Imputation for Supervised Learning

2016-10-28 · Jason Poulos, Rafael Valle

Missing data imputation can help improve the performance of prediction models in situations where missing data hide useful information. This paper compares methods for imputing missing categorical data for supervised cla…

General Classification Imputation

Recover Missing Sensor Data with Iterative Imputing Network

2017-11-20 · Jingguang Zhou, Zili Huang

Sensor data has been playing an important role in machine learning tasks, complementary to the human-annotated data that is usually rather costly. However, due to systematic or accidental mis-operations, sensor data come…

Missing Values

Interval-based Prediction Uncertainty Bound Computation in Learning with Missing Values

2018-03-01 · Hiroyuki Hanada, Toshiyuki Takada, Jun Sakuma, Ichiro Takeuchi

The problem of machine learning with missing values is common in many areas. A simple approach is to first construct a dataset without missing values simply by discarding instances with missing entries or by imputing a f…

Imputation Missing Values Prediction regression

Development of a skateboarding trick classifier using accelerometry and machine learning

2020-05-06 · Nicholas Kluge Corrêa, Julio Cesar Marques de Lima, Thais Russomano, Marlise Araujo dos Santos

Introduction: Skateboarding is one of the most popular cultures in Brazil, with more than 8.5 million skateboarders. Nowadays, the discipline of street skating has gained recognition among other more classical sports and…

BIG-bench Machine Learning Computational Efficiency Motion Detection

Missing Value Imputation With Unsupervised Backpropagation

2013-12-19 · Michael S. Gashler, Michael R. Smith, Richard Morris, Tony Martinez

Many data mining and data analysis techniques operate on dense matrices or complete tables of data. Real-world data sets, however, often contain unknown values. Even many classification algorithms that are designed to op…

Collaborative Filtering General Classification Imputation Missing Values