The appeal of serverless (FaaS) has triggered a growing interest on how to use it in data-intensive applications such as ETL, query processing, or machine learning (ML). Several systems exist for training large-scale ML models on top of serverless infrastructures (e.g., AWS Lambda) but with inconclusive results in terms of their performance and relative advantage over "serverful" infrastructures (IaaS). In this paper we present a systematic, comparative study of distributed ML training over FaaS and IaaS. We present a design space covering design choices such as optimization algorithms and synchronization protocols, and implement a platform, LambdaML, that enables a fair comparison between FaaS and IaaS. We present experimental results using LambdaML, and further develop an analytic model to capture cost/performance tradeoffs that must be considered when opting for a serverless infrastructure. Our results indicate that ML training pays off in serverless only for models with efficient (i.e., reduced) communication and that quickly converge. In general, FaaS can be much faster but it is never significantly cheaper than IaaS.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Towards Demystifying Serverless Machine Learning Training


    Beteiligte:
    Jiang, Jiawei (Autor:in) / Gan, Shaoduo (Autor:in) / Liu, Yue (Autor:in) / Wang, Fanlin (Autor:in) / Alonso, Gustavo (Autor:in) / Klimovic, Ana (Autor:in) / Singla, Ankit (Autor:in) / Wu, Wentao (Autor:in) / Zhang, Ce (Autor:in)

    Erscheinungsdatum :

    2021



    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    Demystifying e^i^

    Scher, D. | British Library Online Contents | 1999


    DEMYSTIFYING DIGITAL TWINS

    Rigby, J. / Mansfield, R. | TIBKAT | 2020


    DEMYSTIFYING the ELECTRIC CAR

    TIBKAT | 2000

    Freier Zugriff

    VEHICLE CONTROL USING SERVERLESS FUNCTIONS

    COSENTINO ANDREA / ANTINORI PAOLO | Europäisches Patentamt | 2023

    Freier Zugriff