Completed project: IUPUI Data Center consolidation and sustainability

Primary UITS contact: Dan Miller

Completed: March 22, 2013

Description: The IUPUI Data Center consolidation and sustainability project focused primarily on achieving the most efficient rack layout and utilization of data center power, cooling, and space via consolidation, standardization, and virtualization. This effort included recycling or repurposing obsolete equipment, consolidating server rack space, and virtualizing physical server supported applications to the Intelligent Infrastructure (II). The standardization aspects of the project also ensure the UITS Data Center Standards are applied consistently to all UITS-managed data centers, providing consistency in policies, procedures, and network configuration across the UITS data centers.

Another major focus of the project included a phased effort to position floor layout and rack alignment, utilizing the current UITS standard APC server racks and installation of the new network configuration, which includes 10 GB uplinks to the core. This phased-in approach resulted in a single row of racks (14 per row) at a time, with one rack dedicated to network management of the entire row. The rack space was assigned, and server hardware was transitioned from the old racks to the new. The project started from the north end of the space and worked to the south end of the data center.

About the data center: Enterprise Infrastructure manages the Advanced Cyberinfrastructure Facilities (data centers) at IU. The IUPUI data center meets the increasing demand for secure information technology facilities on the IUPUI campus. With its hardened design, the data center has an increased capacity to withstand most natural disasters, ensuring the safety and security of IU's most important networking, computer processing, and data storage equipment. The Data Center also provides space and infrastructure needed for DR with the use of I-Light between the campuses via storage environments designed to store offsite copies of institutional data.

Outcome: The project's goal was to substantially improve the Data Center infrastructure Efficiency (DCiE) and Power Usage Effectiveness (PUE) within the physical and financial constraints of the existing facility. This efficient layout allows for maximum efficiency of return air to the CRACs by utilizing hot/cold aisle zones, koldlocks for tile cutouts, and blanking panels in the racks. The standard implementation of SMART CDUs enables future power metering and more accurate billing. The project also resulted in the implementation of consistent practices for the management and configurations of the UITS data centers.

Milestones and status:

  • April-June 2010
    • Complete a site inventory analysis of all equipment Completed
    • Order first and second row of standard server racks (28) Completed
    • Order server rack CDUs Completed
    • Start installation of first and second row Completed
    • Start server and equipment transition to new assigned rack space (SAV) Completed
    • Coordinate/complete move of old racks to free up space to complete the first row
      • Hathi Trust Completed
      • Pathology: Completed
    • Develop internal and external communications plans Completed
    • Periodic updates provided at Change Management meetings Ongoing
    • Pickup of old equipment and racks by surplus
      • 13 racks
      • 4 servers
  • July-October 2010
    • Plan for row 3 and row 4 equipment acquisition Completed
    • Schedule meetings with system owners to discuss move options and strategies Scheduled biweekly meetings - ongoing
    • Order row of standard server racks (28) Completed
    • Order server rack CDUs Completed
    • Installation of the racks, CDUs, and network for the next rows Completed
    • Chilled water distribution unit removal for row 3 Completed
    • Repurpose WCC power equipment UPS, PDU, RDCs, and Fly Wheels
      • Contractor awarded bid Completed
    • Repurpose WCC CRAC (Computer Room Air Conditioner) units
      • Contractor awarded bid Completed
    • RT relocation planning 90% complete
    • Start server and equipment transition to newly assigned rack space
      • Pathology Completed
      • Messaging Completed
      • Open Science Grid Completed
    • Coordinate/complete move of old racks to free up space to complete the row
      • AVL relocation Completed
      • Samgrid relocation Completed
      • SAN Fiber relocation Completed
    • Periodic updates provided at change management meetings Ongoing
    • Pickup of old equipment and racks by surplus
      • 15 racks
      • 4 servers
      • 2 network switches
  • November 2010-January 2011
    • Schedule meetings with system owners to discuss move options and strategies 90% complete
    • Server and equipment transition to newly assigned rack space:
      • Video infrastructure Completed
      • STC Completed
      • POLIS Completed
      • IU Foundation Completed
      • IHETS Completed
      • PTI Completed
      • SAV 3584 Completed
      • Department of Medicine Completed
      • UISO Completed
    • Periodic updates provided at Change Management meetings
    • Install WCC power equipment UPS, PDU, RDCs, and Fly Wheels 95% complete
    • Install WCC CRAC (Computer Room Air Conditioner) units Completed
    • RT rack relocation 20% complete
    • Research network fiber relocated Completed
    • Pickup of old equipment and racks by surplus
      • 14 racks
      • 37 servers
      • 2 network switches
    • Recycled material sold for scrap to Ray's Recycling
      • 13 racks
      • 1 pallet copper cables
      • 5 pallets old power cords
      • 45 old floor tiles
      • Miscellaneous items
  • February 2011-April 2011
    • Server and equipment transition to newly assigned rack space
      • AUX IT Completed
      • International Networks Completed
      • REN ISAC Completed
      • GRNOC Completed
    • RT rack relocation
      • Midwest Tier II Completed
      • Research Storage Completed
    • Retirement of old network zone racks
      • P13 Completed
      • P43 Completed
      • U58 & U59
      • P73
    • Pickup of old equipment and racks by surplus
      • 15 racks
      • Old Operations console
      • 28 servers
  • May 2011-June 2011
    • Plan for next row's (row 6) acquisition
    • Order row of standard server racks if needed Completed
    • Order server rack CDUs Completed
    • Installation of the racks, CDUs, and network for row 6
    • Start server and equipment transition to newly assigned rack space
      • Informatics Completed
      • Library Completed
  • July 2011-September 2011
    • Ivy Tech move-in 100% complete
    • Plan for next row's (row 5) acquisition
    • Order row of standard server racks Completed
    • Order server rack CDUs Completed
    • Installation of the racks, CDUs, and network for row 5 Completed
    • Assign row 5 cabinet space Completed
    • Informatics relocation Completed
    • Library relocation Completed
    • School of Medicine relocation Completed
    • Dept. of Medicine relocation Completed
    • Additional RDCs installation Completed
    • Pickup of old equipment and racks by Ray's Recycling
      • 13 racks
      • Old power cords
      • 14 servers
      • 60 floor tiles
  • October 2011-April 2012
    • IU MedGroup - Primary Care cabinets relocation Completed
    • MidWest Tier 2 cabinet relocation Completed
    • STK Tape Library retired and removed from Data Center Completed
    • New Research IBM tape library installation Completed
    • IU Podcast relocation Completed
    • HelpNet relocation Completed
    • IUPUI School of Education relocation Completed
    • IBM Pseries 575 frame retired and removed from Data Center Completed
    • 12 new APC Cabinets ordered and delivered to Data Center for Row 22; power cords, TOR switches, and fiber cable installations Completed
    • 13 retired SMC server cabinets sent to IUPUI Campus Surplus Completed
    • 30 new power cords installed Completed
    • 108 power receptacles replaced due to water damage that occurred on Dec 12, 2011 Completed
  • Project complete by June 2012
  • Project page completed March 2013

Comment process: Send email to Dan Miller.

Benefits:

  • The new floor layout substantially improves the DCiE and the overall PUE of the IUPUI facility.
  • Network upgrades made the data center network configuration consistent with the IUB Data Center Enterprise pod for improved efficiencies and consistent management.
  • Consistent data center standards in all UITS data center facilities.
  • Standardized server racks and CDUs with power management capabilities.
  • Standardization simplifies trouble-shooting issues efforts across sites.

Project team:

  • Operations group:
    • Dan Miller
    • Gregg Canary
  • Facilities group:
    • Don Brock
    • Eric Goy
    • Doug Chambers
  • Network group:
    • Dave Hunter
    • Cheryl Kile
    • Seth Garrett
  • System Assurance Group (SAG)

Project partners:

All UITS divisional units

  • Enterprise Infrastructure:
    • System Infrastructure
    • Telecommunication Infrastructure
  • Enterprise Software:
    • Enterprise Business Systems
    • Enterprise Student Systems
    • Enterprise Integration
  • Learning Technologies:
    • Academic and Faculty Services
    • Learning Technology Environments
  • Networks
  • Research Technologies
  • Support:
    • Client Support
    • Support Systems, Licensing, and Software Distribution; Executive and Internal Technology Support

OVPIT:

  • Public Safety and Institutional Assurance
  • Administration and Finance Office
  • Communications Office
  • Pervasive Technology Institute

Departmental colocation customers:

  • School of Medicine
  • Department of Medicine
  • IU Medical Group
  • Medicine - Biostatistics
  • Department of Surgery
  • Department of Pediatrics
  • Pathology
  • Center for Bioinformatics (School of Medicine)
  • IUPUI University Library
  • Kelley School of Business
  • Office of Enrollment Services
  • Physical Education
  • Polis
  • School of Informatics
  • IUPUI ADFI
  • IUB Auxiliary Services
  • IUPUI Auxiliary Services
  • School of Education
  • School of Nursing
  • IU Medical Group - Primary Care

Governance:

  • EI AVP: Dennis Cromwell
  • EI Systems Director: John Weakley
  • EI Network Director: Kirt Guinn

This is document azpv in the Knowledge Base.
Last modified on 2017-08-15 14:14:17.

  • Fill out this form to submit your issue to the UITS Support Center.
  • Please note that you must be affiliated with Indiana University to receive support.
  • All fields are required.

Please provide your IU email address. If you currently have a problem receiving email at your IU account, enter an alternate email address.

  • Fill out this form to submit your comment to the IU Knowledge Base.
  • If you are affiliated with Indiana University and need help with a computing problem, please use the I need help with a computing problem section above, or contact your campus Support Center.

Please provide your IU email address. If you currently have a problem receiving email at your IU account, enter an alternate email address.