Formulating recommender system with reinforcement learning (RL) frameworks has attracted increasing attention from both academic and industry communities. While many promising results have been achieved, existing models mostly simulate the environment reward with a unified value, which may hinder the understanding of users' complex preferences and limit the model performance. In this paper, we consider how to model user multi-aspect preferences in the context of RL-based recommender system. More specifically, we base our model on the framework of deterministic policy gradient (DPG), which is effective in dealing with large action spaces. A major challenge for modeling user multi-aspect preferences lies in the fact that they may contradict with each other. To solve this problem, we introduce Pareto optimization into the DPG framework. We assign each aspect with a tailored critic, and all the critics share the same actor. The Pareto optimization is realized by a gradient-based method, which can be easily integrated into the actor and critic learning process. Based on the designed model, we theoretically analyze its gradient bias in the optimization process, and we design a weight-reuse mechanism to lower the upper bound of this bias, which is shown to be effective for improving the model performance. We conduct extensive experiments based on three real-world datasets to demonstrate our model's superiorities.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Reinforcement recommendation with user multi-aspect preference


    Beteiligte:
    Chen, X (Autor:in) / Du, Y (Autor:in) / Xia, L (Autor:in) / Wang, J (Autor:in)

    Erscheinungsdatum :

    2021-04-19


    Anmerkungen:

    In: WWW '21: Proceedings of the Web Conference 2021. (pp. pp. 425-435). ACM: Association for Computing Machinery: New York, NY, USA. (2021)


    Medientyp :

    Paper


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    DDC:    629



    Aspect-Driven User Preference and News Representation Learning for News Recommendation

    Lu, Wenpeng / Wang, Rongyao / Wang, Shoujin et al. | IEEE | 2022


    Parking recommendation system based on user preference and parking space occupancy rate

    YAN PENGYU / XIE HAOYU / CAI XIAOQIANG | Europäisches Patentamt | 2023

    Freier Zugriff


    USER PREFERENCE SPECIFICATION SYSTEM

    NIKI DAISUKE / HAMAYA NAOAKI | Europäisches Patentamt | 2020

    Freier Zugriff