Disaggregated rack-scale data centers have been proposed as the only promising avenue to break the barrier of the fixed CPU-to-memory proportionality caused by main-tray direct-attached conventional/traditional server-centric systems. However, memory disaggregation has stringent network requirements in terms of latency, energy efficiency, bandwidth, and bandwidth density. This paper identifies all the requirements and key performance indicators of a network to disaggregate IT resources while summarizing the progress and importance of optical interconnects. Crucially, it proposes a rack-and-cluster scale architecture, which supports the disaggregation of CPU, memory, storage, and/or accelerator blocks. Optical circuit switching forms the core of this architecture, whereas the end-points (IT resources) are equipped with on-chip programmable hybrid electrical packet/circuit switches. This architecture offers dynamically reconfigurable physical topology to form virtual ones, each embedded with a set of functions. It analyzes the latency overhead of disaggregated DDR4 (parallel) and the proposed hybrid memory cube (serial) memory elements on the conventional and the proposed architecture. A set of resource allocation algorithms are introduced to (1) optimally select disaggregated IT resources with the lowest possible latency, (2) pool them together by means of a virtual network interconnect, and (3) compose virtual disaggregated servers. Simulation findings show up to a 34% resource utilization increase over traditional data centers while highlighting the importance of the placement and locality among compute, memory, and storage resources. In particular, the network-aware locality-based resource allocation algorithm achieves as low as 15 ns, 95 ns, and 315 ns memory transaction round-trip latency on 63%, 22%, and 15% of the allocated virtual machines (VMs) accordingly while utilizing 100% of the CPU resources. Furthermore, a formulation to parameterize and evaluate the additional financial costs endured by ...


    Access

    Download


    Export, share and cite



    Title :

    Optically Disaggregated Data Centers With Minimal Remote Memory Latency: Technologies, Architectures, and Resource Allocation


    Contributors:
    Zervas, G (author) / Yuan, H (author) / Saljoghei, A (author) / Chen, Q (author) / Mishra, V (author)

    Publication date :

    2018-02-01


    Remarks:

    Journal of Optical Communications and Networking , 10 (2) A270-A285. (2018)


    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Resiliency and Disaggregated Space Architectures

    E. Pawlikowski / D. Loverro / T. Cristler | NTIS | 2013


    Optimization of Disaggregated Defense Weather System Follow-on Architectures

    Colombi, John / Thompson, Robert E. / Black, Jonathan | AIAA | 2014



    The Use of Hosted Payloads to Provide Resilient Disaggregated Architectures (AIAA 2014-4338)

    Pang, R. / Deaver, T. / American Institute of Aeronautics and Astronautics | British Library Conference Proceedings | 2014