Highlights Existing data enrichment methods lack ways of a priori performance assessment. A theory for the enrichment performance of the inverse discrete choice modelling (IDCM) approach is proposed. Choice-making process works analogically to the information communication channel. IDCM performs no worse than existing methods in binary enrichment context. IDCM performance can be predicted prior to the enrichment.

    Abstract In light of the growing availability of big data sources and the essential role of socio-demographic information in travel behaviour and transport demand modelling more broadly, the enrichment of socio-demographic attributes for anonymous big datasets is a key issue that continues to be explored. The common shortcoming of existing socio-demographic enrichment approaches concerns their lack of consistent theory that can link their enrichment performance (i.e. the ability to correctly enrich the required attribute) to the underlying covariance structure in the anonymous big datasets. In other words, existing approaches are unable to indicate, prior to the enrichment, to what extent it will be successful. Instead, they require undertaking the enrichment itself to assess and validate it post factum, incurring the effort and cost of the activity. An alternative and arguably preferable way would be to have a prior indicator as to whether an enrichment is likely to be sufficiently effective for the desired application. Towards this end, this paper draws upon the Inverse Discrete Choice Modelling (IDCM) approach to demonstrate what is termed as the IDCM performance theory, which systematically and in a tractable manner links the socio-demographic enrichment performance of the IDCM approach to the structure of the underlying datasets. This is achieved by recalibration of the constant, a technique adopted from conventional discrete choice modelling practice, while also drawing upon information theory employed in the context of communication systems. The established IDCM performance theory is validated in two empirical applications where performance of the IDCM approach in enriching several socio-demographic attributes, given travel behaviour patterns, is successfully estimated. Additionally, the IDCM approach is found to perform comparably to commonly used methods in previous socio-demographic enrichment efforts. It is thus argued that the capability of the IDCM performance theory to predict and explain its enrichment performance under different data conditions can facilitate informed and transparent transferability of the IDCM framework in the socio-demographic enrichment for anonymous big datasets.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Theory for socio-demographic enrichment performance using the inverse discrete choice modelling approach


    Beteiligte:
    Zhao, Yuanying (Autor:in) / Pawlak, Jacek (Autor:in) / Sivakumar, Aruna (Autor:in)


    Erscheinungsdatum :

    2021-11-13


    Format / Umfang :

    34 pages




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    Discrete Choice Modelling for Transportation

    Brownstone, D. / International Association of Travel Behaviour Research | British Library Conference Proceedings | 2001



    Fundamentals of discrete multimodal choice modelling

    Ortuzar, J. de D. | Taylor & Francis Verlag | 1982