Indiana University
University Information Technology Services
  
What are archived documents?
Login>>
Login

Login is for authorized groups (e.g., UITS, OVPIT, and TCC) that need access to specialized Knowledge Base documents. Otherwise, simply use the Knowledge Base without logging in.

Close

At IU, what is Quarry?

On this page:

Introduction

Quarry provides a general-purpose Unix computing environment for academic and instructional use. Quarry is a cluster composed of IBM HS21 Bladeservers and IBM iDataPlex dx340 rack-mounted servers running Red Hat Linux. The Bladeservers run RHEL 4.8, and the dx340 servers run RHEL 5.6. Job management is provided by the TORQUE resource manager (also called PBS) and the Moab job scheduler. The SoftEnv system is used to simplify application access and environment configuration.

The user environment is generally similar to AVIDD's, except that Quarry uses SoftEnv. When you log into Quarry for the first time, a file named ~/.soft is created for you, defining system defaults, such as Intel's C/C++ and Fortran compilers. To add more packages, open your ~/.soft in your favorite editor, and add the appropriate softenv keys or macros.

If you have questions about the system, email the High Performance Systems group. For help with migrating applications or optimizing code, email the High Performance Applications team.

Hardware configuration

Quarry (quarry.uits.indiana.edu) consists of consists of two types of machines:

  • 140 IBM HS21 Blade servers (116 available for general compute use), each containing two Intel Xeon 5335 quad-core processors, 8 or 16 GB of memory, a 36 or 73 GB locally attached SAS disk for local scratch space, and gigabit Ethernet for system interconnects

  • 230 IBM iDataPlex dx340 rack-mounted servers, each with two Intel Xeon E5410 quad- core processors, 16 GB of memory, 98 GB locally attached scratch space, and gigabit ethernet for system interconnects

Following is information about Quarry's cluster nodes:

  • Compute Nodes (140, HS21 Bladeserver):

    • 2 x 2.0 GHz quad-core Intel Xeon 5335 processors
    • 8 or 16 GB 667 MHz DDR2 ECC
    • 36 or 73 GB locally attached SAS disk
    • 340 TB Lustre global scratch (Data Capacitor)
    • 340 TB Lustre global scratch (Data Capacitor - WAN)
    • 2 x 1 GB Ethernet card

  • Compute Nodes (230, iDataPlex dx340 rack-mount servers):

    • 2 x 2.33 GHz Quad-core Intel Xeon 5410 processors
    • 16 GB 667 MHz DDR2 ECC memory
    • 160 GB locally attached SAS disk (98 GB local scratch)
    • 360 TB Lustre global scratch (Data Capacitor)
    • 360 TB Lustre global scratch (Data Capacitor - WAN)
    • 2 x 1 GB Ethernet card

Networking

Each Blade chassis has six gigabit Ethernet connections to a Force10 E1200 switch that connects to the other research systems. Fourteen HS21 Blades, each with gigabit-Ethernet adapters, share those six connections.

Each iDataPlex node has a gigabit Ethernet connection to a rack-mounted BNT 8000 rack-mounted switch. Forty-two servers in each half iDataPlex rack share a switch, which has a single 10 GB uplink to the research network.

Storage

Shared scratch space is hosted on the Data Capacitor, which is accessible from Quarry. The path to your scratch space is /N/dc/scratch/username (replace username with your username). Files older than 60 days are periodically purged, following user notification.

Home directory disk space is allocated on the IBM N5500 NAS storage device. The default 10 GB disk quota is shared with Big Red and the RDC (if you have accounts on those systems).

More information

For more, see:

This is document avju in domain all.
Last modified on November 23, 2011.

Comments/Questions/Corrections

Use this form to offer suggestions, corrections, and additions to the Knowledge Base. We welcome your input!

If you are affiliated with Indiana University and would like assistance with a specific computing problem, please use the Ask a Consultant form, or contact your campus Support Center.

Contact Information

Note: We will reply to your comment at this address. If your message concerns a problem receiving email, please enter an alternate email address.