This paper presents the first large-scale application of deep reinforcement learning to optimize the placement of limit orders at cryptocurrency exchanges. For training and out-of-sample evaluation, we use a virtual limit order exchange to reward agents according to the realized shortfall over a series of time steps. Based on the literature, we generate features that inform the agent about the current market state. Leveraging 18 months of high-frequency data with 300 million historic trades and more than 3.5 million order book states from major exchanges and currency pairs, we empirically compare state-of-the-art deep reinforcement learning algorithms to several benchmarks. We find proximal policy optimization to reliably learn superior order placement strategies when compared to deep double Q-networks and other benchmarks. Further analyses shed light into the black box of the learned execution strategy. Important features are current liquidity costs and queue imbalances, where the latter can be interpreted as predictors of short-term mid-price returns. To preferably execute volume in limit orders to avoid additional market order exchange fees, order placement tends to be more aggressive in expectation of unfavorable price movements.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Deep reinforcement learning for the optimal placement of cryptocurrency limit orders


    Beteiligte:

    Erscheinungsdatum :

    2020-01-01


    Anmerkungen:

    RePEc:zbw:iwqwdp:052020


    Medientyp :

    Paper


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    330 / 629




    Adaptive Function Placement with Distributed Deep Reinforcement Learning in RAN Slicing

    Tsukamoto, Yu / Hirayama, Haruhisa / Il Moon, Seung et al. | IEEE | 2022


    Deep Reinforcement Learning-based Optimal Time-constrained Intercept Guidance

    Sinha, Abhinav / White, Devin / Cao, Yongcan | AIAA | 2024


    Deep reinforcement learning for multi-objective placement of virtual machines in cloud datacenters

    Caviglione L. / Gaggero M. / Paolucci M. et al. | BASE | 2020

    Freier Zugriff

    Optimal placement of electric vehicle charging infrastructures utilizing deep learning

    Alansari, Mohamad / Al‐Sumaiti, Ameena Saad / Abughali, Ahmed | Wiley | 2024

    Freier Zugriff

    Optimal placement of electric vehicle charging infrastructures utilizing deep learning

    Mohamad Alansari / Ameena Saad Al‐Sumaiti / Ahmed Abughali | DOAJ | 2024

    Freier Zugriff