What is a batch job?

A batch job is a computer program or set of programs processed in batch mode. This means that a sequence of commands to be executed by the operating system is listed in a file (often called a batch file, command file, or shell script) and submitted for execution as a single unit. The opposite of a batch job is interactive processing, in which a user enters individual commands to be processed immediately.

In many cases, batch jobs accumulate during working hours, and are then executed during the evening or another time the computer is idle. This is often the best way to run programs that place heavy demands on the computer.

On high-performance compute clusters, users typically submit batch jobs to queues, which are classes of compute nodes, managed by a resource manager, such as TORQUE (based on OpenPBS). Frequently, clusters employ separate job schedulers, such as Moab, to dispatch batch jobs based on the availability of compute resources, job requirements specified by users, and usage policies set by cluster administrators.

The high-performance research computing systems at Indiana University use TORQUE for submitting and monitoring jobs. TORQUE relies on Moab Workload Manager to dispatch jobs.

For your batch job to run properly on Big Red II, your TORQUE job script must be tailored specifically for the Cray Linux Environment; TORQUE scripts for running jobs on systems running other Linux distributions, such as Red Hat Enterprise Linux (RHEL) or CentOS, will not work on Big Red II without modifications. For more, see How do I run batch jobs on Big Red II at IU?

This is document afrx in the Knowledge Base.
Last modified on 2018-02-02 11:05:16.

Contact us

For help or to comment, email the UITS Support Center.