Sessions

Accelerate High Performance Computing on the Cloud

Abstract

Scala Computing provides a secure, hyper-scalable platform allowing users to run their HPC applications on the Cloud. Scala’s goal was to optimize the ns3 application to provide Network Vendors and HyperScalars an extremely powerful simulation platform. Our solutions allow users to run extensive network simulations determining proper network topology, stack solutions and equipment configuration determining how machine learning algorithms affect data center efficiency for their enormous user-base. Simulation speed is of the essence meaning, compute clusters with proper high-speed compute and memory ratio solutions are extremely important to providing desired results. This is where Scala’s use of AWS provided not only proper instances for configuring HPC clusters, but many additional solutions in cluster deployment and security. We evaluated many instance types and determined AWS Z1Ds using the Intel Xeon Scalable processor was the perfect choice. The sustained core frequency of 4 GHz and 384 GB of RAM allowed Scala to understand what consistent performance can be achieved with various optimizations. Parallelizing compute capabilities using MPI was key to running large scale simulations without simulation completion times increasing to undesirable levels where running “what-if” scenarios became too time consuming. Scala Computing spent significant time analyzing various MPI solutions to determine the best results for our customers. After many tests across numerous configurations, Intel’s iMPI solution was a clear winner. The partnership using both AWS and Intel solutions allowed Scala to have one of the first efficient Discrete Event Network Simulators to run at Data Center Scale.

Speakers

Sam Rahman, CTO, Scala Computing

Sam joined Scala as their Head of Engineering and founding member where he leads all aspects of development and the daily management of the engineering team. In this role, Sam has been driving many of the engineering efforts at Scala Computing and spearheading the development of the core platform. Prior to joining Scala, Sam has served as CTO and Co-founder of DidItLabs, a VC backed startup specializing in NLP for location services. At DidIt, Sam raised $2.5Mn in Seed round financing from VCs in addition to leading all engineering and product development efforts within the organization. Prior to starting DidIt, Sam started and sold another early-stage software start-up and served as the Head of Mobile and Connected Devices at BamTech (acquired by Disney for $1.6Bn) where he developed the AtBat app, one of the first applications on the Apple app store and, till this day, one of the most popular iPhone applications of all time.