ARCHIVED: At IU, how do I use parallel FTP to transfer data to or from the SDA?
Note: For information about other methods of accessing the SDA, see Access the SDA at IU
For parallel transfers to and from Indiana University's Scholarly
Data Archive (SDA) (formerly known as MDSS), UITS
recommends using the Unix-based pftp_client
. For more on
pftp_client
, see the Brookhaven National Laboratory pftp_client
page. For more on the pftp protocol, see A
Parallel File Transfer Protocol for Clusters and Grid Systems.
To use pftp_client
to transfer data to or from the
SDA:
- Run the
kinit
command to authenticate to HPSS. Use the syntax shown below (with your IU Network ID username in place ofusername
):kinit username@ADS.IU.EDU
- Enter:
pftp_client ftp.sdarchive.iu.edu
- Enter:
site setcos n
Replace
n
with1
for small files (0-4MB),2
for medium files (4-64MB), and3
for large files (64MB-1TB). - Enter:
lcd directoryname
Replace
directoryname
with the name of the directory containing your files. - For each file you want to transfer into SDA, enter the following,
replacing
filename
with the name of the file:pput filename
If you use
put
instead ofpput
, usuallypftp_client
will automatically usepput
instead. - For each file you want to transfer out of SDA, enter the
following, replacing
filename
with the name of the file:pget filename
If you use
get
instead ofpget
, usuallypftp_client
will automatically usepget
instead. - When you're finished, enter:
quit
This is document aukx in the Knowledge Base.
Last modified on 2018-01-18 15:39:46.