HighlightsA methodology is proposed to design heuristics for model selection given characteristics of data.The proposed method does not need any post-modeling inputs.Heuristics were designed to select between the NB and NB-L distributions.Skewness is found to be a key factor to choose between the NB and NB-L distributions.The selected distribution based on characteristics can later be used to develop GLMs.

    AbstractSafety analysts usually use post-modeling methods, such as the Goodness-of-Fit statistics or the Likelihood Ratio Test, to decide between two or more competitive distributions or models. Such metrics require all competitive distributions to be fitted to the data before any comparisons can be accomplished. Given the continuous growth in introducing new statistical distributions, choosing the best one using such post-modeling methods is not a trivial task, in addition to all theoretical or numerical issues the analyst may face during the analysis. Furthermore, and most importantly, these measures or tests do not provide any intuitions into why a specific distribution (or model) is preferred over another (Goodness-of-Logic). This paper ponders into these issues by proposing a methodology to design heuristics for Model Selection based on the characteristics of data, in terms of descriptive summary statistics, before fitting the models. The proposed methodology employs two analytic tools: (1) Monte-Carlo Simulations and (2) Machine Learning Classifiers, to design easy heuristics to predict the label of the ‘most-likely-true’ distribution for analyzing data. The proposed methodology was applied to investigate when the recently introduced Negative Binomial Lindley (NB-L) distribution is preferred over the Negative Binomial (NB) distribution. Heuristics were designed to select the ‘most-likely-true’ distribution between these two distributions, given a set of prescribed summary statistics of data. The proposed heuristics were successfully compared against classical tests for several real or observed datasets. Not only they are easy to use and do not need any post-modeling inputs, but also, using these heuristics, the analyst can attain useful information about why the NB-L is preferred over the NB - or vice versa- when modeling data.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A methodology to design heuristics for model selection based on the characteristics of data: Application to investigate when the Negative Binomial Lindley (NB-L) is preferred over the Negative Binomial (NB)



    Erschienen in:

    Erscheinungsdatum :

    2017-07-04


    Format / Umfang :

    9 pages




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    The negative binomial-Lindley generalized linear model: Characteristics and application using crash data

    Geedipally, Srinivas Reddy / Lord, Dominique / Dhavala, Soma Sekhar | Elsevier | 2011



    Evaluating alternative variations of Negative Binomial–Lindley distribution for modelling crash data

    Khodadadi, Ali / Shirazi, Mohammadali / Geedipally, Srinivas et al. | Taylor & Francis Verlag | 2023


    Finite mixture Negative Binomial-Lindley for modeling heterogeneous crash data with many zero observations

    Islam, A.S.M. Mohaiminul / Shirazi, Mohammadali / Lord, Dominique | Elsevier | 2022


    Effects of design consistency on run-off-road crashes: An application of a Random Parameters Negative Binomial Lindley model

    Khan, Shinthia Azmeri / Afghari, Amir Pooyan / Yasmin, Shamsunnahar et al. | Elsevier | 2023