[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [HTCondor-users] equivalent job array option for condor_submit
- Date: Thu, 04 Aug 2016 17:51:52 -0400
- From: Michael V Pelletier <Michael.V.Pelletier@xxxxxxxxxxxx>
- Subject: Re: [HTCondor-users] equivalent job array option for condor_submit
From: "Upton, Stephen (Steve) (CIV)" <scupton@xxxxxxx>
Date: 08/04/2016 04:36 PM
> Is there an equivalent to job array like in SLURM or PBS where you
> submit specific job numbers? Iâm aware of queue, but that seems to
> up a specified number of jobs, starting from 0. Iâm looking
> ability to specify a set of job numbers or ranges, that kind of thing.
> didnât find anything googling nor in the docs (but could be looking
> wrong place or using a different terminology).
The trick here is to do math with the $(Process) macro
in the submit
description, or use the 8.4 "queue in" feature.
Prior to 8.4 this was a bit peculiar since you had
to use the $$()
format with the ProcID attribute or a ClassAd array,
instead of the
submit description macros, but now it's quite a bit
So to do something numbered from 1 instead of zero:
CASE_ID = $(Process) + 1
arguments = --case=$INT(CASE_ID)
The argument will become "--case=1" for
process 0, and so on.
To do something numbered 10, 20, 30, etc, it's the
CASE_ID = $(Process) * 10 + 10
The "queue in," "queue matching,"
and "queue from" commands
allow you to specify Python-style slices as start:end:step,
so you can constrain the runs that way.
For example, if you want to run the first three values
your list of RNG seeds:
queue SEED in 0:3 ( 123, 456, 789, 012, 345, 678,
This would set $(SEED) to 123, 456, and 789 in processes
0, 1, and 2 respectively.