Re: [HTCondor-users] Non-sequential input files?

[John M Knoeller <johnkn@xxxxxxxxxxx>]

I would think this would be pretty easy to implement the equivalent of queue matching in python, but you canât invoke condor_submitâs âqueue matchingâ code from the HTCondor python bindings.

 

-tj

 

From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx] On Behalf Of Sandeep Gupta
Sent: Wednesday, February 28, 2018 8:59 AM
To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Subject: Re: [HTCondor-users] Non-sequential input files?

 

This is a pretty awesome feature.

 

Currently, is there anyway I can use this from python bindings as well? e.g.

 

```

with schedd.transaction() as txn:

    sub.queue(txn, njobs, numbers)

```

 

where numbers is a list I want to specify as an argument to each of the jobs. Of course, an invariant is `len(njobs) == len(numbers)`

 

 

Looking at https://github.com/htcondor/htcondor/blob/master/src/python-bindings/schedd.cpp#L1933, it doesn't seem that we can do this currently, but it would definitely be something very nice to have. 

 

 

Thanks.

Sandeep.

 

On Tue, Feb 27, 2018 at 11:15 AM, John M Knoeller <johnkn@xxxxxxxxxxx> wrote:

• simply skip the jobs where the input file is not present, rather than aborting the job submission as it normally does?

 

This sounds like a job for queue matching

 

If you have a set of input files in a directory, you can tell condor_submit to create a job for each file like this

 

input = $(INFILE)

queue INFILE files matching (/path/to/files/*)

 

-tj

 

 

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

 

This message (including any attachments) contains confidential information intended for a specific individual and purpose, and is protected by law. If you are not the intended recipient, you should delete this message and are hereby notified that any disclosure, copying, or distribution of this message, or the taking of any action based on it, is strictly prohibited.