At IU, how do I stage my SDA files so they'll be available when I want them?

By default, when you retrieve files stored on the Indiana University Scholarly Data Archive (SDA), they are staged (i.e., copied from tape to a disk cache) first, and then transferred to you from the disk copies. Depending on system traffic, this can cause a delay in file transfer process.

Alternatively, you can stage your files to disk cache ahead of time, so they'll be ready to transfer when you want them. To do so, use the Hierarchical Storage Interface (HSI) stage command:

  • To run stage in the background, at the HSI prompt, enter (replace filename with the name of your file):
      stage filename
  • To run the command in the foreground (if you want to wait for staging to finish), at the HSI prompt, enter (replace filename with the name of your file):
      stage -w filename
Note:
If you leave your files staged on disk too long before retrieving them, an increase in system traffic may get them removed from disk cache (i.e., "unstaged"). If this happens, you can still retrieve you files, but you may experience a delay while the files are restaged (copied from tape to disk cache) again.

For more about HSI, see At IU, how do I use HSI to access my SDA account?

Important:
Files containing PHI must be encrypted when they are stored (i.e., at rest) and when they are transferred between networked systems (i.e., in transit). Do not use HSI, HTAR, or Samba to transfer data containing PHI unless those data are encrypted already; HSI, HTAR, and Samba do not encrypt data during transit. To ensure that files containing PHI remain encrypted during transit, use SFTP/SCP or the SDA web interface. To ensure that files containing PHI are encrypted when they are stored on the SDA, encrypt them before transferring them. For more, see Recommended tools for encrypting data containing HIPAA-regulated PHI .

This is document avas in the Knowledge Base.
Last modified on 2018-02-23 14:54:41.

  • Fill out this form to submit your issue to the UITS Support Center.
  • Please note that you must be affiliated with Indiana University to receive support.
  • All fields are required.

Please provide your IU email address. If you currently have a problem receiving email at your IU account, enter an alternate email address.

  • Fill out this form to submit your comment to the IU Knowledge Base.
  • If you are affiliated with Indiana University and need help with a computing problem, please use the I need help with a computing problem section above, or contact your campus Support Center.

Please provide your IU email address. If you currently have a problem receiving email at your IU account, enter an alternate email address.