Technical Design

For SC14 our design is focused around building a single server capable of meeting the data transfer needs of a site connected at 100G and delivering this data over high performance networks provided by CANARIE, BCNET, CenturyLink and SCinet.

Network between UVic and the SC show floor

Network between UVic and the SC show floor

To do this we have employed a Dell R920 server populated with six 2.6 TB SanDisk FusionIO ioDrive2 Duo cardsĀ  connected to Brocade MLXe-4 with a 100G CFP2 module and a 4x40G module.

The position of Mellanox and SanDisk FusionIO cards in the R920.

The position of Mellanox and SanDisk FusionIO cards in the R920.

In order to be successful the system must be tuned with the NUMA architecture of the system in mind (see figure above). Scripts for assigning the appropriate device IRQ to CPUs were developed and posted to Github.