Use the IU Globus Web App for SDA and DC2 file transfers

Note:
The SDA web interface was retired on October 21, 2018. For web-based access to your SDA data, use the instructions on this page to select and activate the IU - Scholarly Data Archive endpoint in the IU Globus Web App. If you have questions or concerns, contact the UITS Research Storage team.

On this page:


Overview

You can use the IU Globus Web App to transfer data between your accounts on IU research computing and storage systems. You also can use it to move data to an IU research system from a personal computer (or vice versa), or use it to transfer data to and from other networked hosts, such as digital services on the Extreme Science and Engineering Discovery Environment (XSEDE). For example, you can use the IU Globus Web App to:

  • Transfer output data from an application running on an IU research supercomputer to your archival storage space on the Scholarly Data Archive (SDA).
    Important:
    Before storing data on the SDA, make sure you understand the information in Types of sensitive institutional data appropriate for the Scholarly Data Archive at IU.
  • Transfer data from your laptop to your Data Capacitor II (DC2) scratch space or DC-WAN2 project space for use with an application running on an IU research supercomputer.
  • Transfer your application's output data from your SDA account to your account on an XSEDE visualization system.

The IU Globus Web App is based on Globus Online, a high-performance GridFTP service designed to provide researchers a tool for secure data movement between networked hosts (endpoints). The IU Globus Web App automates many of the tasks associated with managing large data transfers, saving you time and delivering better performance than other transfer methods, such as SCP.

Access the IU Globus Web App

To access the IU Globus Web App:

  1. In your web browser, go to the IU Globus Web App .
  2. Under "Use your existing organizational login", use the drop-down list to find and select Indiana University.
  3. Click Continue. Sign into IU Login (formerly CAS) with your IU username and passphrase. Confirm your identity with Duo two-step login.

Set up a transfer between two endpoints

To set up a data transfer in the IU Globus Web App, select and activate the desired endpoints. Endpoint names commonly start with text signifying the name of the host institution, department, group, or individual, followed by the hostname or nickname of the networked resource. For example:

IU resource Endpoint name
Scholarly Data Archive (SDA) IU - Scholarly Data Archive
Data Capacitor II (DC2) iu#dc2

To select and activate endpoints in the IU Globus Web App:

  1. From File Manager, click in the text field next to "Collection" and begin typing an endpoint name (for example, enter IU) to automatically reveal a list of available endpoints.
  2. Scroll through the list to find the desired endpoint (for example, IU - Scholarly Data Archive), and then click its name to activate it.
  3. Click in the Transfer or sync to... field and begin typing the name of the second endpoint (for example, enter IU again), and then scroll the through the list of results to find and click on the desired endpoint name (for example, iu#dc2) to activate it.

With two endpoints activated, you can start transferring files between them.

Note:
  • To use the IU - Scholarly Data Archive endpoint, you must have an SDA account. To use the iu#dc2 endpoint, you must have an account on one of IU's research supercomputers. For eligibility and account creation information, see the Research system accounts (all campuses) section of Computing accounts at IU.
  • When activating an IU endpoint, you won't be prompted to log in; the IU Globus Web App automatically passes your IU credentials to the endpoint.
  • Activating the IU - Scholarly Data Archive endpoint places you in the home directory of your account on the SDA. Activating the iu#dc2 endpoint places you in your personal scratch space.

Transfer files

Important:

Files containing personal health information (PHI) must be encrypted when they are stored (at rest) and when they are transferred between networked systems (in transit). To ensure that files containing PHI are encrypted when they are stored, encrypt them before transferring them. For more, see Recommended tools for encrypting data containing HIPAA-regulated PHI.

Before transferring files containing PHI to an IU endpoint, make sure you understand the information in Your legal responsibilities for protecting data containing protected health information (PHI) when using UITS Research Technologies systems and services.

To transfer files between endpoints:

  1. Use the source endpoint's file browser to find and select one or more files and/or folders to transfer, and then click Transfer or Sync to....
  2. To reveal optional transfer settings, near the bottom of the screen, click Transfer & Sync Options, and then:
    • Optionally, click in the text field next to "Label This Transfer" and enter a short text description, which will be displayed in the log of transfer activity.
    • Check the boxes to select preferred settings:
      • sync - only transfer new or changed files
      • delete files on destination that do not exist on source
      • preserve source file modification times
      • verify file integrity after transfer (This setting is selected by default.)
      • encrypt transfer (If you are transferring files containing PHI, make sure encrypt transfer is selected to ensure that your files remain encrypted during transit. If the IU - Scholarly Data Archive endpoint is activated, this setting will be selected and cannot be changed.)
  3. Use the destination endpoint's file browser to select the destination directory for the selected files and/or folders.
  4. To start the transfer, below the source file browser, click Start. Above the two endpoints, you should see a "Transfer request submitted successfully" message and a corresponding "Task id" number. You can click the task ID number to see an overview of your transfer and monitor its progress.

Add your personal computer as an endpoint

To use your personal computer as an endpoint:

  1. In the IU Globus Web App , click File Manager, and then, near the top of the screen, click inside the "Collection" field.
  2. Under the "Collection" field, on the Recent tab, click Install Globus Connect Personal.
  3. On the "Create New GCP Endpoint" screen:
    1. Under "Step 1 Name Your Endpoint":
      • Next to "Endpoint Display Name", enter a human-friendly name for your Globus Connect Personal endpoint. UITS recommends combining your IU username with an informal name for your computer, for example:
          username#my_laptop
        
      • If you plan to use the IU Globus Web App to transfer data containing HIPAA-protected personal health information (PHI), select this will be a high assurance endpoint.
        Important:

        At Indiana University, never store files containing sensitive institutional data, especially protected health information (PHI) regulated by the Health Insurance Portability and Accountability Act of 1996 (HIPAA), on your desktop workstation, laptop, USB flash drive, tablet, smartphone, or other mobile device unless the files are properly encrypted on the device, and your senior executive officer or the IU Institutional Review Board (IRB) has given prior written approval. Because PHI must remain encrypted at rest, make sure you are using full-disk encryption on any device that has research data containing PHI on it. If you are not sure, ask your department or school IT Pro for help.

        UITS provides consulting and online help for Indiana University researchers, faculty, and staff who need help securely processing, storing, and sharing data containing protected health information (PHI). If you have questions about managing HIPAA-regulated data at IU, contact UITS HIPAA Consulting. To learn more about properly ensuring the safe handling of PHI on UITS systems, see the UITS IT Training video Securing HIPAA Workflows on UITS Systems. For additional details about HIPAA compliance at IU, see HIPAA Privacy and Security Compliance

      • Next to "Associated Identity", make sure your username@iu.edu identity is selected.
    2. Under "Step 2 Generate a Setup Key for Installation", click Generate Setup Key, and then copy the setup key that's generated.
    3. Under "Step 3 Download & Install Globus Connect Personal", click to download the installer for your operating system (macOS, Linux, or Windows).
  4. Run the downloaded installer (you'll need to be logged into your computer as an administrator). When the installation is complete, make sure Run Globus Connect Personal is selected before closing the installer.
  5. When prompted, paste in your Globus Connect Personal setup key, and then click OK.
  6. When prompted to modify local folder access settings, click Yes, Modify Settings to select which local folders will be accessible and/or writable by Globus Connect Personal; then, when you are finished selecting accessible folders, click Save.

Get help

Support for IU research computing systems, software, and services is provided by the Research Technologies division of UITS. To ask a question or get help, contact UITS Research Technologies.

This is document bdqp in the Knowledge Base.
Last modified on 2019-07-03 10:46:08.

Contact us

For help or to comment, email the UITS Support Center.