Transatlantic 100GE Demonstration with CANARIE


The Canadian High Energy Physics network organization, HEPnet/Canada at the University of Victoria and CANARIE,  together with their colleagues at Caltech, showed that researchers can fully exploit the new Advanced North Atlantic 100GE (ANA-100) 100 gigabit/second transatlantic link between NYC and Amsterdam provided by CANARIE and their partners Internet2 (USA), NORDUnet, (Nordic countries), ESnet (U.S. Department of Energy), SURFnet (Netherlands).

High performance networking testbeds at CERN in Geneva Switzerland and Ottawa, Canada were connected with the ANA-100 transatlantic circuit and a series of increasing bandwidth memory-to-memory network transfer were performed. The team was able to reach a maximum sustained network throughput from CERN to Ottawa of 94 Gbps using only two specially configured Linux servers in each location. In addition a peak bidirectional average throughput of 127 Gbps was sustained over a period of 11 hours.

ANA-100 94 Gbps

ANA-100 traffic while moving data from CERN to Ottawa on May 5, 2014. The rate peaks at a sustained 94 Gbps.

Each server used in the demonstration was configured with two Mellanox 40GE Network cards. The transfers were performed using only 3 pairs of cards and 25 parallel TCP streams in total. All transfers were completed using the high performance, open source, data transfer tool FDT developed by Caltech and others.

Optical transport across the ANA-100 link and within Canada is done using Ciena Equipment. The 100G transatlantic demo was enabled by Juniper Networks, who loaned the group a 100G router, and by CERN, who gave us access to their networks and computing facilities. Scalar Decisions acted as supplier for the servers used in Ottawa.

Figure 1: ANA-100 CANARIE Testebed located in Ottawa Canada.

ANA-100 CANARIE Testbed located in Ottawa Canada.