ARCHIVED: Use the IU Globus Web App to transfer data between your accounts on IU's research computing and storage systems

This content has been archived, and is no longer maintained by Indiana University. Information here may no longer be accurate, and links may no longer be available or reliable.

On this page:

Overview

You can use the IU Globus Web App to transfer data between your accounts on Indiana University's research supercomputers and research storage systems. You also can use it to transfer data between an IU research supercomputer and your personal computer.

For example, you can use the IU Globus Web App to:

The IU Globus Web App is based on Globus Online, a high-performance GridFTP service designed to provide researchers a tool for secure data movement between networked hosts (collections). The IU Globus Web App automates many of the tasks associated with managing large data transfers, saving you time and delivering better performance than other transfer methods, such as SCP.

Access the IU Globus Web App

Note:

To access the SDA from off campus, UITS recommends protocols such as Globus and SFTP, which provide IU Login and Two-Step Login (Duo) authentication, as well as encryption in transit. Because the HSI/HTAR protocols don't provide the same protections, to remotely access the SDA with a local HSI/HTAR client you must first email store-admin@iu.edu to request an off-campus exemption.

To access the IU Globus Web App:

  1. In your web browser, go to the IU Globus Web App.
  2. Under "Use your existing organizational login", use the drop-down list to find and select Indiana University.
  3. Click Continue.

  4. Log in with your IU username and passphrase, and then confirm your identity with Two-Step Login (Duo).

Activate your collections

To set up a data transfer in the IU Globus Web App, select and activate the source and destination collections.

Note:
  • To use an IU system as a collection, you must have an account on that system. For eligibility and account creation information, see the Research system accounts (all campuses) section of Computing accounts at IU.
  • When activating an IU collection, you won't be prompted to log in; the IU Globus Web App automatically passes your IU username and passphrase to the host system.
  • You can activate a Globus collection hosted at another institution if you know the collection's name and have an account on the host system.
  1. From File Manager, click in the text field next to "Collection" and begin typing a collection name; for example, enter IU to automatically reveal a list of available IU collections.
  2. Scroll through the list to find the desired collection; for example:
    IU resource Collection name
    Scholarly Data Archive (SDA)
    Slate, Slate-Project, or Slate-Scratch IURT - Slate
  3. When you find the desired collection, click its name to activate it:
    • Activating the collection places you in the home directory of your account on the SDA.
    • Activating the IURT - Slate collection may produce a "permission" denied" error at first. The error will resolve when you click in the "Path" field, enter the appropriate path, as follows, and press Enter or Return:
      • Slate: To activate your Slate account, enter the following path (replace username with the IU username associated with your Slate account): 
        /N/slate/username
      • Slate-Project: To activate your Slate-Project space, enter the following path (replace project_name with the project name associated with your Slate-Project space): 
        /N/project/project_name
      • Slate-Scratch: To activate your Slate-Scratch directory, enter the following path (replace username) with the IU username associated with your Slate-Scratch directory): 
        /N/scratch/username
  4. Click in the Transfer or sync to... field, and then repeat the previous steps to find and activate your second collection.

With two collections activated, you can start transferring files between them.

Transfer files

Important:

Files containing personal health information (PHI) must be encrypted when they are stored (at rest) and when they are transferred between networked systems (in transit). To ensure that files containing PHI are encrypted when they are stored, encrypt them before transferring them. For more, see Recommended tools for encrypting data containing HIPAA-regulated PHI.

Before transferring files containing PHI to an IU collection, make sure you understand the information in Your legal responsibilities for protecting data containing protected health information (PHI) when using UITS Research Technologies systems and services.

To transfer files between collections:

  1. Use the source collection's file browser to find and select one or more files and/or folders to transfer, and then click Transfer or Sync to....
  2. To reveal optional transfer settings, select Transfer & Timer Options, and then (optionally):
    • Next to "Label This Transfer", in the text box, enter a short description to be displayed in the log of transfer activity.
    • Next to "Transfer Settings", check the boxes to select preferred settings:
      • sync - only transfer new or changed files
      • delete files on destination that do not exist on source
      • preserve source file modification times
      • do NOT verify file integrity after transfer
      • Skip files on source with errors
      • Fail on quota errors
      Note:
      The encrypt transfer option is enabled and cannot be changed.
    • Next to "Notification Settings", check the boxes to select preferred settings:
      • Disable success notification
      • Disable failure notification
      • Disable inactive notification
    • To schedule your transfer to run on a specific date and time, next to "Schedule Start", use the pop-up calendar and text box to enter a valid date and time to indicate when your transfer should start.
    • To set up a recurring transfer, next to Repeat, use the drop-down to select days, hours, or minutes, and then:
      • Next to "every", use the up and down arrows to set the frequency.
      • Next to "end", use the drop-down to indicate when the recurrence should end; select never, after (a set number of times), or by date (a set date and time).
  3. Use the destination collection's file browser to select the destination directory for the selected files and/or folders.
  4. To start the transfer, click Start. You should see a "Transfer request submitted successfully" message and a corresponding "Task id" number. You can click the task ID number to see an overview of your transfer and monitor its progress.

Add your personal computer as a collection

This content has been archived, and is no longer maintained by Indiana University. Information here may no longer be accurate, and links may no longer be available or reliable.

To use your personal computer as a collection:

  1. In the IU Globus Web App, click File Manager, and then, near the top of the screen, click inside the "Collection" field.
  2. Under the "Collection" field, on the Recent tab, click Install Globus Connect Personal.
  3. Download the Globus Connect Personal version that's compatible with your workstation's operating system (Windows, macOS, or Linux), install it, and then launch it.
  4. When Globus Connect Personal runs, it will take you through the process of setting up your computer as a collection. Make sure to remember the name you give your collection; UITS recommends combining your IU username with an informal name for your computer, for example: 
    username#my_laptop
  5. When you finish creating your collection, you can return to the IU Globus Web App and search for your collection by entering its name into the "Collection" field on the File Manager tab.
Important:

At Indiana University, never store files containing sensitive institutional data, especially protected health information (PHI) regulated by the Health Insurance Portability and Accountability Act of 1996 (HIPAA), on your desktop workstation, laptop, USB flash drive, tablet, smartphone, or other mobile device unless the files are properly encrypted on the device, and your senior executive officer or the IU Institutional Review Board (IRB) has given prior written approval. Because PHI must remain encrypted at rest, make sure you are using full-disk encryption on any device that has research data containing PHI on it. If you are not sure, ask your department or school local UITS support person for help.

If you have questions about securing HIPAA-regulated research data at IU, email securemyresearch@iu.edu. SecureMyResearch provides self-service resources and one-on-one consulting to help IU researchers, faculty, and staff meet cybersecurity and compliance requirements for processing, storing, and sharing regulated and unregulated research data; for more, see About SecureMyResearch. To learn more about properly ensuring the safe handling of PHI on UITS systems, see the UITS IT Training video Securing HIPAA Workflows on UITS Systems. To learn about division of responsibilities for securing PHI, see Shared responsibility model for securing PHI on UITS systems.

Add your Google at IU My Drive or Microsoft OneDrive at IU space as a collection

The UITS Research Storage team provides Globus collections for Google at IU My Drive and Microsoft OneDrive at IU as an individualized custom service. To request additional information, email the UITS Research Storage team.

Once you are provided access, you can follow the instructions above to search for and activate your collections, and transfer data between Google at IU My Drive, Microsoft OneDrive at IU, and your accounts on IU's research supercomputers and research storage systems.

Get help

Research computing support at IU is provided by the Research Technologies division of UITS. To ask a question or get help regarding Research Technologies services, including IU's research supercomputers and research storage systems, and the scientific, statistical, and mathematical applications available on those systems, contact UITS Research Technologies. For service-specific support contact information, see Research computing support at IU.

This is document bdqp in the Knowledge Base.
Last modified on 2023-04-10 15:41:39.