ARCHIVED: How can I get my XSEDE data transfers to run faster?

This content has been archived, and is no longer maintained by Indiana University. Information here may no longer be accurate, and links may no longer be available or reliable.

While many of the factors that affect data transfer rates are intrinsic to the system you are using and not under your control, you can follow these guidelines to increase the efficiency of your data transfers:

Unless you're moving very small files, your file transfers will be markedly more efficient if you use a GridFTP client.
Use dedicated GridFTP servers, wherever possible, using a third-party transfer.
Plan ahead and send results of your jobs to fast file systems, where available.
If you are transferring multiple small files, create a tarball.

If you need help, see ARCHIVED: Get help with XSEDE.

This document was developed with support from National Science Foundation (NSF) grants 1053575 and 1548562. Any opinions, findings, conclusions, or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the NSF.