[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Non-sequential input files?



This is a pretty awesome feature.

Currently, is there anyway I can use this from python bindings as well? e.g.

```
with schedd.transaction() as txn:
  sub.queue(txn, njobs, numbers)
```

where numbers is a list I want to specify as an argument to each of the jobs. Of course, an invariant is `len(njobs) == len(numbers)`


Looking atÂhttps://github.com/htcondor/htcondor/blob/master/src/python-bindings/schedd.cpp#L1933, it doesn't seem that we can do this currently, but it would definitely be something very nice to have.Â


Thanks.
Sandeep.

On Tue, Feb 27, 2018 at 11:15 AM, John M Knoeller <johnkn@xxxxxxxxxxx> wrote:
  • simply skip the jobs where the input file is not present, rather than aborting the job submission as it normally does?

Â

This sounds like a job for queue matching

Â

If you have a set of input files in a directory, you can tell condor_submit to create a job for each file like this

Â

input = $(INFILE)

queue INFILE files matching (/path/to/files/*)

Â

-tj

Â

Â


_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@cs.wisc.edu with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/


This message (including any attachments) contains confidential information intended for a specific individual and purpose, and is protected by law. If you are not the intended recipient, you should delete this message and are hereby notified that any disclosure, copying, or distribution of this message, or the taking of any action based on it, is strictly prohibited.Â