Learning-to-rank has been intensively studied and has shown significantly increasing values in a wide range of domains, such as web search, recommender systems, dialogue systems, machine translation, and even computational biology, to name a few. In light of recent advances in neural networks, there has been a strong and continuing interest in exploring how to deploy popular techniques, such as reinforcement learning and adversarial learning, to solve ranking problems. However, armed with the aforesaid popular techniques, most studies tend to show how effective a new method is. A comprehensive comparison between techniques and an in-depth analysis of their deficiencies are somehow overlooked. This paper is motivated by the observation that recent ranking methods based on either reinforcement learning or adversarial learning boil down to policy-gradient-based optimization. Based on the widely used benchmark collections with complete information (where relevance labels are known for all items), such as MSLRWEB30K and Yahoo-Set1, we thoroughly investigate the extent to which policy-gradient-based ranking methods are effective. On one hand, we analytically identify the pitfalls of policy-gradient-based ranking. On the other hand, we experimentally compare a wide range of representative methods. The experimental results echo our analysis and show that policy-gradient-based ranking methods are, by a large margin, inferior to many conventional ranking methods. Regardless of whether we use reinforcement learning or adversarial learning, the failures are largely attributable to the gradient estimation based on sampled rankings, which significantly diverge from ideal rankings. In particular, the larger the number of documents per query and the more fine-grained the ground-truth labels, the greater the impact policy-gradient-based ranking suffers. Careful examination of this weakness is highly recommended for developing enhanced methods based on policy gradient.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Diagnostic Evaluation of Policy-Gradient-Based Ranking


    Beteiligte:
    Yu, Hai-Tao (Autor:in) / Huang, Degen (Autor:in) / Ren, Fuji (Autor:in) / Li, Lishuang (Autor:in)

    Erscheinungsdatum :

    2022-07-14


    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629




    Gradient-Aware Model-Based Policy Search

    Pierluca D'Oro / Alberto Maria Metelli / Andrea Tirinzoni et al. | BASE | 2020

    Freier Zugriff


    RANKING - Ranking 2013 — Kaum Veränderungen

    Schedel, Roland | Online Contents | 2013


    RANKING - Ranking 2012 — Weiter aufwärts

    Schedel, Roland | Online Contents | 2012


    RANKING - Ranking 2011 — Solides Wachstum

    Brünglinghaus, Christiane | Online Contents | 2011