Concurrent Running Jobs

Within the batch system HTCondor it is possible to limit the number of concurrent running jobs.

You only need to specify in your job_submission_file how many units of the default limit every job consumes. A default limit is set to 1000 units.

The command used to define limits is:

concurrency_limits = $(Owner):Y

where Y is the number of units that each job uses (1000 / „requested_max_number_of_running_jobs“ = Y).

Example 1: If you want to specify limits for all your submitted jobs even in different submissions, e.g. for 50 concurrent running jobs (i.e. 1000 / 50 = 20 units per one job) just add next line to your job_submission_file:

concurrency_limits = $(Owner):20

Example 2: If you want to apply limits only within each job submission, then use the cluster ID in the name of the limit, e.g. for 25 concurrent running jobs (i.e. 1000 / 25 = 40 units per one job) just add next line to your job_submission_file:

concurrency_limits = $(ClusterID):40