23 February 2021

The next generation DAS, DAS-6, will be available shortly! DAS-6 is currently being installed and tested. It is expected to become available for regular use in March/April 2021.

May, 2016

IEEE Computer publishes paper about 20 years of Distributed ASCI Supercomputer. See the DAS Achievements page.

DAS-6 clusters

DAS-6 is built from single- and dual-socket compute nodes, built by Lenovo. The most common single-CPU compute node has a 24-core AMD EPYC-2 (Rome) 7402P CPU. The most common dual-CPU compute node has two 16-core AMD EPYC-2 (Rome) 7282 CPU. The system is distributed, spread out over six clusters, located at five sites. Unlike its predecessor, DAS-5, DAS-6 has a configuration which is different per site:

Cluster Nodes Most common Speed Memory Central storage Node storage Interconnect GPUs
VU 34 single 24-core 2.8 GHz 128 GB 256 TB 1.8TB NVMe 100G Eth TBD
LU 18 single 24-core 2.8 GHz 128 GB 96 TB 2*0.8TB NVMe + 2*4TB 100G IB -
UvA-SNE 8 dual 16-core 2.8 GHz 128 GB 256 TB 2*1.5TB NVMe + 10*4TB 100G Eth TBD
TUD 20 dual 16-core 2.8 GHz 128 GB 96 TB 2*4TB 100G IB TBD
UvA-AI 12 single 24-core 2.8 GHz 128 GB 96 TB 2*1.8TB NVMe 100G IB TBD
ASTRON 5 dual 16-core 2.8 GHz 128 GB 96 TB 1.8TB NVMe 100G Eth TBD

Besides using the ubiquitous Ethernet (1 Gbit/s at the compute nodes, 10 Gbit/s on the head nodes), DAS-6 also employs the high speed 100 Gbit/s InfiniBand and 100 Gbit/s RoCE Ethernet interconnect technologies. For this each node has a Mellanox network interface which can be configured in either 100G InfiniBand or 100G Ethernet mode, depending on the locally available interconnect switch.

The operating system the DAS-6 runs is CentOS 8 Linux. Cluster management and HPC software provisioning is done using OpenHPC cluster management and software suite.