ARCHIVED: Forward resource limits from your shell to your batch job on Big Red II at IU

This content has been archived, and is no longer maintained by Indiana University. Information here may no longer be accurate, and links may no longer be available or reliable.
Note:

Big Red II was retired from service on December 15, 2019; for more, see ARCHIVED: About Big Red II at Indiana University (Retired).

On Big Red II at Indiana University, user resource limits set in the shell (with ulimit in bash, or limit in tcsh) are not automatically forwarded to batch jobs on the Extreme Scalability Mode (ESM) or Cluster Compatibility Mode (CCM) compute nodes.

To enable the forwarding of user resource limits, set the APRUN_XFER_LIMITS runtime environment variable to 1 (one) by adding one of the following lines (depending on the shell) to your job script:

  • In bash, add:
    export APRUN_XFER_LIMITS=1
    
  • In tcsh, add:
    setenv APRUN_XFER_LIMITS 1
    

For example:

  • ESM job (bash shell):
    #!/bin/bash
    #PBS -l nodes=1:ppn=32
    #PBS -l walltime=00:30:00
    #PBS -q cpu
    #PBS -j oe
      
    export APRUN_XFER_LIMITS=1  
    aprun -n 32 ~/my_code
    
  • CCM job (tcsh shell):
    #!/bin/tcsh
    #PBS -l nodes=1:ppn=16
    #PBS -l walltime=00:30:00
    #PBS -l gres=ccm
    #PBS -j oe  
    
    setenv APRUN_XFER_LIMITS 1
    module load ccm
    ccmrun ~/my_code
    

For more about the APRUN_XFER_LIMITS runtime environment variable, see its entries in the aprun and ccmrun manual pages:

man aprun | less -p"APRUN_XFER_LIMITS"
man ccmrum | less -p"APRUN_XFER_LIMITS"

Support for IU research supercomputers, software, and services is provided by various teams within the Research Technologies division of UITS.

For general questions about research computing at IU, contact UITS Research Technologies.

For more options, see Research computing support at IU.

This is document bdvg in the Knowledge Base.
Last modified on 2019-12-15 07:03:36.