Highlights Existing data enrichment methods lack ways of a priori performance assessment. A theory for the enrichment performance of the inverse discrete choice modelling (IDCM) approach is proposed. Choice-making process works analogically to the information communication channel. IDCM performs no worse than existing methods in binary enrichment context. IDCM performance can be predicted prior to the enrichment.
Abstract In light of the growing availability of big data sources and the essential role of socio-demographic information in travel behaviour and transport demand modelling more broadly, the enrichment of socio-demographic attributes for anonymous big datasets is a key issue that continues to be explored. The common shortcoming of existing socio-demographic enrichment approaches concerns their lack of consistent theory that can link their enrichment performance (i.e. the ability to correctly enrich the required attribute) to the underlying covariance structure in the anonymous big datasets. In other words, existing approaches are unable to indicate, prior to the enrichment, to what extent it will be successful. Instead, they require undertaking the enrichment itself to assess and validate it post factum, incurring the effort and cost of the activity. An alternative and arguably preferable way would be to have a prior indicator as to whether an enrichment is likely to be sufficiently effective for the desired application. Towards this end, this paper draws upon the Inverse Discrete Choice Modelling (IDCM) approach to demonstrate what is termed as the IDCM performance theory, which systematically and in a tractable manner links the socio-demographic enrichment performance of the IDCM approach to the structure of the underlying datasets. This is achieved by recalibration of the constant, a technique adopted from conventional discrete choice modelling practice, while also drawing upon information theory employed in the context of communication systems. The established IDCM performance theory is validated in two empirical applications where performance of the IDCM approach in enriching several socio-demographic attributes, given travel behaviour patterns, is successfully estimated. Additionally, the IDCM approach is found to perform comparably to commonly used methods in previous socio-demographic enrichment efforts. It is thus argued that the capability of the IDCM performance theory to predict and explain its enrichment performance under different data conditions can facilitate informed and transparent transferability of the IDCM framework in the socio-demographic enrichment for anonymous big datasets.
Theory for socio-demographic enrichment performance using the inverse discrete choice modelling approach
Transportation Research Part B: Methodological ; 155 ; 101-134
2021-11-13
34 pages
Article (Journal)
Electronic Resource
English
Discrete Choice Modelling for Transportation
British Library Conference Proceedings | 2001
|Fundamentals of discrete multimodal choice modelling
Taylor & Francis Verlag | 1982
|Implications of Thresholds in Discrete Choice Modelling
Online Contents | 2006
|