High Throughput Networking Special Interest Group

Last updated: 
3 months 1 week ago
Group Manager

This is the High Throughput special interest group on line group. Network performance problems may cause issues to scientists and network operators alike.  Throughput problems can be caused by many factors - including infrastructure, hosts, applications.  Researchers that encounter network problems sometimes can use this resource to facilitate troubleshooting, tuning and get general advice from the community.


Over the past 2-3 years a number of scientific disciplines have purchased large instruments that are capable in generating appreciably large datasets. In addition to this increase in data production, there is a requirement for the produced data to be processed and analysed. Generation and processing capabilities are physically located in different locations around the UK, therefore there is a growing requirement from the community to transfer large (>1Tb) files, or multiple thereof, in the shortest possible time frame.


The US Energy Sciences Network has a number of throughput test servers that Janet users can use to check their transatlantic throughput between hosts. These DTN's or data transfer nodes use GridFTP as their application for data transfer, and have a wide range of file sizes from 1MB to 100GB. The Servers are based in Lawrence Berkley National Lab, California; Argonne National Lab, Chicago and Brookhaven National Lab, New York.  


Here is an archive of an historic working group organised by Mark Leese at the Council for the Central Laboratory of the Research Councils (CCLRC), now known as STFC.

*The following text is taken from the web archive of the group*

Networks for Non-Networkers 2 (NFNN2) was a one and a half day workshop for people working at the technical level in high-bandwidth dependent science. It is not aimed at network researchers or networking experts, but at people trying to use the network for science; people who have questions like:


Here is a extremely well put together and useful web resource. The Energy Sciences network developed this Knowledge Base and provides advice around:

  • Network Architecture, including the Science DMZ model
  • Host Tuning
  • Network Tuning
  • Data Transfer Tools
  • Network Performance Testing

The the knowledgebase can be found here http://fasterdata.es.net/

Prev | Next