Implementing Blindingly Fast Data Transfers Between Distant Sites
Paul
K Hyder
Forecast Systems Lab, OAR
Actual transfer speeds of large data sets between distant NOAA
locations, across the existing wonderous high speed interconnects,
are usually much slower than they should be. The primary constraint
is not, as one might expect, link load or host speed. It turns
out to be the network configuration for the host sending data,
i.e. It can be corrected.
Tutorial will consist of a discussion of network
tools and tuning
parameters specific to large TCP/IP data transfers focusing on
optimizing data transfer speeds.
New versions of common data transfer tools like
FTP will be
introduced and we will cover the why, what, and how-to
aspects of high speed networks.
None
of this is actually new technology, it just needs to be implemented
across NOAA.