Use the IU Globus Web App to transfer data between your accounts on IU's research computing and storage systems

On this page:


Overview

Note:
The Scholarly Data Archive (SDA) web interface was retired on October 21, 2018. For web-based access to your SDA data, use the instructions on this page to select and activate the IU - Scholarly Data Archive endpoint in the IU Globus Web App. If you have questions or concerns, contact the UITS Research Storage team.

The IU Globus Web App is based on Globus Online, a high-performance GridFTP service designed to provide researchers a tool for secure data movement between networked hosts (endpoints). The IU Globus Web App automates many of the tasks associated with managing large data transfers, saving you time and delivering better performance than other transfer methods, such as SCP.

You can use the IU Globus Web App to transfer data between your accounts on Indiana University's research computing and storage systems. You also can use it to transfer data between an IU research system and your personal computer, or use it to transfer data to and from other networked hosts, such as digital services on the Extreme Science and Engineering Discovery Environment (XSEDE).

For example, use the IU Globus Web App to:

  • Transfer data from your personal computer to your Data Capacitor II (DC2), Slate, or Slate-Project space for use with an application running on an IU research computer.
  • Transfer output data from an application running on an IU research supercomputer to your archival storage space on the Scholarly Data Archive (SDA).
    Important:
    Before storing data on the SDA, make sure you understand the information in Types of sensitive institutional data appropriate for the Scholarly Data Archive at IU.
  • Transfer your application's output data from your SDA account to your account on an XSEDE visualization system.

Access the IU Globus Web App

Note:

To access the Scholarly Data Archive from an off-campus location, first connect to the IU VPN.

To access the IU Globus Web App:

  1. In your web browser, go to the IU Globus Web App .
  2. Under "Use your existing organizational login", use the drop-down list to find and select Indiana University.
  3. Click Continue. Sign into IU Login with your IU username and passphrase. Confirm your identity with Duo two-step login.

Activate the source and destination endpoints

To set up a data transfer in the IU Globus Web App, select and activate the source and destination endpoints.

  1. From File Manager, click in the text field next to "Collection" and begin typing an endpoint name; for example, enter IU to automatically reveal a list of available IU endpoints.
  2. Scroll through the list to find the desired endpoint; for example:
    IU resource Endpoint name
    Scholarly Data Archive (SDA) IU - Scholarly Data Archive
    DC2, Slate or Slate-Project iu#hpfs
  3. When you find the desired endpoint, click its name to activate it:
    • Activating the IU - Scholarly Data Archive endpoint places you in the home directory of your account on the SDA.
    • Activating the iu#hpfs endpoint places you in the Research Technologies home directory file system at /N/. To activate your DC2 scratch or project space, or your space on Slate or Slate-Project, as an endpoint, click in the "Path" field, add the remainder of the path to /N/, and then press Enter or Return. For example:
      • DC2 scratch: Replace username with your IU username:
        /N/dc2/scratch/username
        
      • DC2 project space: Replace project_name with the name of your project space):
        /N/dc2/projects/project_name
        
      • Slate: Replace username with the IU username associated with your Slate account:
        /N/slate/username
        
      • Slate-Project: Replace project_name with the project name associated with your Slate-Project space:
        /N/project/project_name
        
    Note:
  4. Click in the Transfer or sync to... field, and then repeat the previous steps to find and activate your second endpoint.

With two endpoints activated, you can start transferring files between them.

Transfer files

Important:

Files containing personal health information (PHI) must be encrypted when they are stored (at rest) and when they are transferred between networked systems (in transit). To ensure that files containing PHI are encrypted when they are stored, encrypt them before transferring them. For more, see Recommended tools for encrypting data containing HIPAA-regulated PHI.

Before transferring files containing PHI to an IU endpoint, make sure you understand the information in Your legal responsibilities for protecting data containing protected health information (PHI) when using UITS Research Technologies systems and services.

To transfer files between endpoints:

  1. Use the source endpoint's file browser to find and select one or more files and/or folders to transfer, and then click Transfer or Sync to....
  2. To reveal optional transfer settings, near the bottom of the screen, click Transfer & Sync Options, and then:
    • Optionally, click in the text field next to "Label This Transfer" and enter a short text description, which will be displayed in the log of transfer activity.
    • Check the boxes to select preferred settings:
      • sync - only transfer new or changed files
      • delete files on destination that do not exist on source
      • preserve source file modification times
      • verify file integrity after transfer (This setting is selected by default.)
      • encrypt transfer (If you are transferring files containing PHI, make sure encrypt transfer is selected to ensure that your files remain encrypted during transit. If the IU - Scholarly Data Archive endpoint is activated, this setting will be selected and cannot be changed.)
  3. Use the destination endpoint's file browser to select the destination directory for the selected files and/or folders.
  4. To start the transfer, below the source file browser, click Start. Above the two endpoints, you should see a "Transfer request submitted successfully" message and a corresponding "Task id" number. You can click the task ID number to see an overview of your transfer and monitor its progress.

Add your personal computer as an endpoint

To use your personal computer as an endpoint:

  1. In the IU Globus Web App , click File Manager, and then, near the top of the screen, click inside the "Collection" field.
  2. Under the "Collection" field, on the Recent tab, click Install Globus Connect Personal.
  3. On the "Create New GCP Endpoint" screen:
    1. Under "Step 1 Name Your Endpoint":
      • Next to "Endpoint Display Name", enter a human-friendly name for your Globus Connect Personal endpoint. UITS recommends combining your IU username with an informal name for your computer, for example:
          username#my_laptop
        
      • If you plan to use the IU Globus Web App to transfer data containing HIPAA-protected personal health information (PHI), select this will be a high assurance endpoint.
        Important:

        At Indiana University, never store files containing sensitive institutional data, especially protected health information (PHI) regulated by the Health Insurance Portability and Accountability Act of 1996 (HIPAA), on your desktop workstation, laptop, USB flash drive, tablet, smartphone, or other mobile device unless the files are properly encrypted on the device, and your senior executive officer or the IU Institutional Review Board (IRB) has given prior written approval. Because PHI must remain encrypted at rest, make sure you are using full-disk encryption on any device that has research data containing PHI on it. If you are not sure, ask your department or school IT Pro for help.

        UITS provides consulting and online help for Indiana University researchers, faculty, and staff who need help securely processing, storing, and sharing data containing protected health information (PHI). If you have questions about managing HIPAA-regulated data at IU, contact UITS HIPAA Consulting. To learn more about properly ensuring the safe handling of PHI on UITS systems, see the UITS IT Training video Securing HIPAA Workflows on UITS Systems. For additional details about HIPAA compliance at IU, see HIPAA Privacy and Security Compliance

      • Next to "Associated Identity", make sure your username@iu.edu identity is selected.
    2. Under "Step 2 Generate a Setup Key for Installation", click Generate Setup Key, and then copy the setup key that's generated.
    3. Under "Step 3 Download & Install Globus Connect Personal", click to download the installer for your operating system (macOS, Linux, or Windows).
  4. Run the downloaded installer (you'll need to be logged into your computer as an administrator). When the installation is complete, make sure Run Globus Connect Personal is selected before closing the installer.
  5. When prompted, paste in your Globus Connect Personal setup key, and then click OK.
  6. When prompted to modify local folder access settings, click Yes, Modify Settings to select which local folders will be accessible and/or writable by Globus Connect Personal; then, when you are finished selecting accessible folders, click Save.

Get help

Support for IU research computing systems, software, and services is provided by the Research Technologies division of UITS. To ask a question or get help, contact UITS Research Technologies.

This is document bdqp in the Knowledge Base.
Last modified on 2019-12-03 10:42:28.

Contact us

For help or to comment, email the UITS Support Center.