Dev Hub

DAOS Unleashes the Power in HPC Applications: QCT DevCloud Experience Sharing

Abstract

In this session, Quanta Cloud Technology (QCT) introduces its experience of utilizing Distributed Asynchronous Object Storage (DAOS) system in QCT DevCloud. In addition, QCT compares the performance of DAOS and Lustre® filesystem on the 2nd Generation Intel® Xeon® Scalable Processor based platform, and a comparison the DAOS performance on the Intel 2nd and 3rd Generation Intel Xeon scalable processor based platforms. We show that DAOS outperforms Lustre over metadata and small file operations by orders of magnitude. Further DAOS performance doubles generation to generation when running on the Intel 3rd generation Intel Xeon Processor based scalable platform thanks to lower latency and higher bandwidth of Intel® Optane™ Persistent Memory 200 and increased bandwidth of Intel D7-P5510 series NVMEs with PCIe Gen4.

Explore DAOS Storage for HPC.

Article: Unlock the Power of DAOS in Python with PyDAOS

Speaker

Grover Hwang, Technical Manager and Solution Architect, Quanta Cloud Technology (QCT)

Grover Hwang is the technical manager and solution architect at Quanta Cloud Technology (QCT). He leads a team to optimize HPC workloads over various platforms. Before joining QCT, he was the administrator of multiple HPC systems for more than fifteen years, including several mission-critical ones. He focuses on introducing cutting-edge software and hardware technologies to accelerate HPC workloads and fulfill customers’ ever-growing computation and storage demands.