Dev Hub

A Compact, Scalable, Efficient Data Collection Solution for Edge/IoT to Cloud​

Abstract

The ever increasing use of high-output scientific instruments urgently demands a cost-effective, simple, scalable, and efficient data collection solution. This is especially true in the health care and life science (HCLS) industry. This talk presents a solution that combines the latest innovations from Intel, Zettar, AWS HCLS, and Supermicro to create a compact, highly scalable, HA, yet simple and cost-effective data collection solution.​ Also described: Intel innovations in Optane technology and DAOS, an open-source development by Intel. It leverages the unique capabilities of Intel PMEM and NVMe SSDs; Zettar's unified data mover has proven simplicity, scalability, and efficiency that has been spurred by its support of the ambitious data movement requirements of a premier DOE Exascale Computing preparation project, Linac Coherent Light Source II (LCLS-II); AWS HCLS - the most dominant in providing a highly productive cloud based environment for the various analysis pipelines for biomedical research; Supermicro’s flexible offerings of its flash-based storage servers.

Explore DAOS Storage for HPC.

Article: Unlock the Power of DAOS in Python with PyDAOS

Speakers

Chin Fang, PhD, Founder & CEO, Zettar Inc.

Chin Fang is the founder & CEO of Zettar Inc. (Zettar). He holds a master’s and a doctoral engineering degree from Stanford University. Zettar’s mission is to create a simple, scale-out capable, versatile, and efficient unified data mover software for moving data at scale and speed. Targeted users include modern distributed enterprises engaged in data-intensive endeavors such as large-scale AI research and tier-1 science projects such as the Linac Coherent Light Source II (LCLS-II). In March 2019, Zettar was awarded the only Overall Winner of the Supercomputing Asia Data Mover Challenge, a grueling two-month long international competition at the highest level. Dr. Fang led the Zettar team, which beat out six other elite national teams from the U.S. and Japan by a wide margin. Since 2015, Zettar has been engaged to support the ambitious data movement requirements of LCLS-II, a premier U.S. DOE Exascale Computing preparation project. Zettar is supported by its revenue and has been awarded highly competitive grants by two U.S. federal agencies, the National Science Foundation and the Department of Energy.

Andrey Kudryavtsev, DAOS Product Management, Intel Corporation

Andrey is in the DAOS Product Management role at Intel with more than 20 years of total server experience. Andrey has an unique mix of expertise in the storage technology from the file system stack down to the device level. He graduated from Nizhny Novgorod State University in Russia by Computer Science. Andrey holds patents in SSD development for component failure mitigation. Prior to joining DAOS group he worked on Optane technology enabling as Solution Architect. Outside of the work he is the owner and co-author of many experimental technologies in music, musical instruments design and electric vehicle conversion projects.