How do I limit the number of concurrent running jobs?

A: You only need to specify in your job_submission_file how many units of the default limit every job consumes. A default limit is set to 1000 units. The command used to define limits is:

concurrency_limits = $(Owner):Y

where Y is the number of units that each job uses (1000 / “max number of running jobs” = Y).

Example 1: If you want to specify limits for all your submitted jobs even in different submissions, e.g. for 50 concurrent running jobs (i.e. 1000 / 50 = 20 units per one job), just add next line to your job_submission_file:

concurrency_limits = $(Owner):20

Example 2: If you want to apply limits only within each job submission, then use the cluster ID in the name of the limit, e.g. for 25 concurrent running jobs (i.e. 1000 / 25 = 40 units per one job), just add next line to your job_submission_file:

concurrency_limits = $(ClusterID):40