How do I forward resource limits from my shell to my batch job on Big Red II at IU?

On Big Red II at Indiana University, user resource limits set in the shell (with ulimit in bash, or limit in tcsh) are not automatically forwarded to batch jobs on the Extreme Scalability Mode (ESM) or Cluster Compatibility Mode (CCM) compute nodes.

To enable the forwarding of user resource limits, set the APRUN_XFER_LIMITS runtime environment variable to 1 (one) by adding one of the following lines (depending on the shell) to your job script:

  • In bash, add:
      export APRUN_XFER_LIMITS=1
  • In tcsh, add:
      setenv APRUN_XFER_LIMITS 1

For example:

ESM job (bash shell) CCM job (tcsh shell)
  #!/bin/bash
  #PBS -l nodes=1:ppn=32
  #PBS -l walltime=00:30:00
  #PBS -q cpu
  #PBS -j oe
  
  export APRUN_XFER_LIMITS=1  
  aprun -n 32 ~/my_code
  #!/bin/tcsh
  #PBS -l nodes=1:ppn=16
  #PBS -l walltime=00:30:00
  #PBS -l gres=ccm
  #PBS -j oe  

  setenv APRUN_XFER_LIMITS 1
  module load ccm
  ccmrun ~/my_code

For more about the APRUN_XFER_LIMITS runtime environment variable, see its entries in the aprun and ccmrun manual pages:

  man aprun | less -p"APRUN_XFER_LIMITS"
  man ccmrum | less -p"APRUN_XFER_LIMITS"

For more on running batch jobs on Big Red II, see:

Support for IU research computing systems, software, and services is provided by various UITS Research Technologies units. For help, see Research computing support at IU.

This is document bdvg in the Knowledge Base.
Last modified on 2017-07-25 09:08:47.

  • Fill out this form to submit your issue to the UITS Support Center.
  • Please note that you must be affiliated with Indiana University to receive support.
  • All fields are required.

Please provide your IU email address. If you currently have a problem receiving email at your IU account, enter an alternate email address.

  • Fill out this form to submit your comment to the IU Knowledge Base.
  • If you are affiliated with Indiana University and need help with a computing problem, please use the I need help with a computing problem section above, or contact your campus Support Center.

Please provide your IU email address. If you currently have a problem receiving email at your IU account, enter an alternate email address.