SURF.net news

Tag: SuperComputing

  • Successful trial: 1.2 Tbit/s data transfer to prepare long-haul network for AI and supercomputing

    Successful trial: 1.2 Tbit/s data transfer to prepare long-haul network for AI and supercomputing

    CSC, SURF, and Nokia have successfully tested a high-capacity, quantum-safe fibre-optic connection exceeding 1.2 terabit per second (Tbit/s) between Amsterdam and Kajaani (Finland) with data traversing over 3.500 kilometres. The trial demonstrated the potential of ultra-fast, cross-border connectivity for research.

    Tests were carried out along several routes, including the longest, which spanned 4,700 km through Norway at a capacity of 1Tbit/s. To put this in perspective, 1 Tbit/s is enough to stream 200,000 full HD movies (at 5 Mbit/s each) simultaneously.  

    These results are particularly promising as the research community prepares for supercomputers and AI Factories to come online – where reliable, scalable, and secure connections will be critical to supporting some of the world’s largest datasets and most demanding workloads.

    The test used a combination of real research data and synthetic data, transferred directly from disk to disk – from SURF’s facility in Amsterdam to CSC’s data center in Kajaani, across five production research and education networks: SURF (the Netherlands), NORDUnet (Nordic backbone), Sunet (Sweden), SIKT (Norway) and Funet (CSC’s network in Finland). 

    The network solution was based on Nokia’s IP/MPLS routing and quantum-safe optical networking gear. Nokia’s IP technology successfully demonstrated Flexible Ethernet (FlexE) to accommodate “elephant flows”, or very large continuous flows of data, and its high-capacity optical transport technology showed the ability to handle massive data sets generated by HPCs over long distances. 

    Distance between supercomputing centers is no obstacle

    With the exponential growth of research data, especially for training large-scale AI models, the need for resilient, high-throughput and secure connectivity is more critical than ever. This test confirms that multi-domain, high-capacity data transfers across European research networks are both feasible and future-ready. Testing an operational network connection over long distances provides unique insights into data transport and storage of large data volumes. The tests are crucial for improving the infrastructure for data-intensive research.  

    “We design research networks with future needs in mind,” said Jani Myyry, Senior Network Specialist at CSC. “CSC’s datacenter in Kajaani already hosts the pan-European LUMI supercomputer, and with the upcoming LUMI-AI supercomputer and AI Factory coming online, reliable and scalable data connections throughout Europe are essential. Even though the geographical distance is significant, it poses no obstacle to data traffic.” 

    Ready to take the next step in aligning European supercomputers

    “As SURF, we are ready to take the next step in aligning European supercomputers,” said Arno Bakker, Senior Network Specialist at SURF. “These efforts offer future perspectives to train federated LLM as OpenEuroLLM

    on LUMI and Snellius or for a researcher to compute on LUMI with very large datasets hosted at SURF, such as the KNMI (The Royal Netherlands Meteorological Institute) datasets.” 

    “This test would not have been possible without the support of NIKHEF, the Dutch national institute for subatomic physics. Their experience in handling huge amounts of physics measurement data and available hardware ensures that these kinds of tests can be done successfully. In addition, Bakker says we are very grateful to our Scandinavian partners for their help setting up this trail connection. This is again an example of the continued good cooperation between NRENs to create the best possible international infrastructure for research and education.”

    “Groundbreaking trials like this highlight how advanced networks are foundational to unlocking the full potential of AI and high-performance computing,” said Mikhail Lenko,Customer Solutions Architect for Nokia. “This successful collaboration with CSC and SURF is a testament to the innovation and leadership of the scientific community, and to what’s possible when we work together.”

    “As the network prepares for the next wave of supercomputers and AI Factories, we are proud to deliver the quantum-safe, high-capacity, and resilient IP/MPLS and optical infrastructure that makes these systems viable. We look forward to continuing our support for global research and education networks, helping them scale with confidence and drive the next generation of discovery and innovation.”

  • International Collaboration at SuperComputing24: NetherLight/SURF participates in NICT-led experiment to advance high-speed data innovations

    International Collaboration at SuperComputing24: NetherLight/SURF participates in NICT-led experiment to advance high-speed data innovations

    During the SuperComputing 2024 (SC24) event in Atlanta, the Japanese National Institute of Information and Communications Technology (NICT) led an ambitious experiment using a global-scale experimental network. This network, established through collaboration with 19 international partners, connected Tokyo and Atlanta with 10 high-speed 100 Gbps paths, achieving a total capacity of 800 Gbps. The project showcased groundbreaking demonstrations of high-speed data transfer, anonymous communication, and innovative data management.

    One notable highlight was a data transfer experiment that reached 466 Gbps, and an award-winning anonymous communication demonstration by Osaka University achieved 588 Gbps while ensuring robust privacy. 

    NetherLight, the Global Exchange Point (GXP) run by SURF, played a critical role facilitating these complex experiments. Other key contributors included research and education networks and GXP’s from around the world, showcasing the collective effort required to achieve such innovation.

    This NICT experiment at SC24 emphasizes the importance of international collaboration and partnerships in global research and education networks. By working together in experiments like these, we can collectively show and assess the potential for transformative technologies in data handling and communication, essential for future scientific progress.

    For more details, pictures and graphics, and information about the contributing parties in this experiment, please read the full NICT press release here.

  • SC24: Advancing Distributed Hybrid Quantum Computing with SURF and NetherLight

    SC24: Advancing Distributed Hybrid Quantum Computing with SURF and NetherLight

    At SuperComputing 2024 (SC24) in Atlanta, an international collaboration showcased a groundbreaking demonstration of distributed hybrid quantum computing secured by advanced post-quantum cryptography (PQC) and quantum key distribution (QKD). This global effort brought together partners from Europe and the USA, highlighting how quantum and classical computing systems can be integrated and secured on a world scale.

    The Challenge and Opportunity of Quantum Computing

    Quantum computing holds immense potential for solving complex problems in fields like chemistry, biology, meteorology, and financial systems—challenges beyond the reach of classical computing. However, the technology’s cost, sensitivity, and limited availability present hurdles to its widespread application. Moreover, quantum computing threatens the security of current encryption systems, raising the stakes for robust, future-proof solutions.

    To address these challenges, the demonstration aimed to:

    1. Combine quantum computing with classical resources to improve accessibility and cost-effectiveness.

    2. Enable global distribution of these hybrid systems for broader researcher access.

    3. Protect these systems and data against threats in a post-quantum cryptographic environment.

    International Collaboration Driving Innovation

    This demonstration was the result of an international partnership involving European organizations (PSNC, GÉANT, SURF/NetherLight) and U.S. institutions (Internet2, ESnet, ICAIR/Northwestern University, StarLight). Together, they built a transatlantic hybrid quantum-classical computing network connecting testbeds in Poznan, Poland, and Atlanta, USA, using live production networking infrastructure.

    SURF and its NetherLight exchange played a pivotal role, enabling global connectivity alongside other major networks like GÉANT, Internet2, and SCinet. This collaborative approach leveraged expertise and resources from all partners to push the boundaries of what’s possible in quantum and classical computing integration.

    Technical Breakthroughs and Secure Data Transmission

    The demonstration showcased:

    – Hybrid quantum-classical computing integration using Quantum Processing Units (QPUs), CPUs, and GPUs.

    – High-speed data transmission over transatlantic links secured with PQC algorithms and QKD encryption.

    – Advanced security measures, including DWDM services for long-distance encryption and QKD technology for local network data security.

    This setup demonstrated the viability of a distributed quantum-classical infrastructure capable of supporting research use cases in fields like material science and optimization. By employing existing quantum computing systems with ~100 qubit capacity, the project advances the goal of achieving “quantum utility.”

    A Model for Future Innovation

    The SC24 demonstration underscores the power of international collaboration to solve complex challenges and drive technological breakthroughs. By integrating cutting-edge technologies and resources from diverse global partners, this project paves the way for the next generation of secure, distributed quantum computing infrastructure.

    SURF and NetherLight’s participation exemplifies their commitment to advancing science and innovation through global partnerships. Together with other partners, they are demonstrating how collective efforts can unlock the potential of quantum computing for research and education worldwide.

    The project was featured at SC24’s Network Research Exhibition, with a live presentation at the NRE Theatre, showcasing the transformative potential of distributed hybrid quantum computing.

    For further information and the full press release, please continue here.