[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] process number to start higher than zero



Something like?

cmd = /bin/cat
args = $([100 + $(Process)]).in
input = $([100 + $(Process)]).in
output = $(Process).out
queue 51

It's still an RFE,

https://condor-wiki.cs.wisc.edu/index.cgi/tktview?tn=488

Until that is resolved, did you know condor_submit reads from stdin?

$ cat 100.in
hi
$ cat 101.in
bye

$ for i in $(seq 100 101); do echo "cmd = /bin/cat\nargs = $i.in\ninput = $i.in\noutput = $i.out\nqueue"; done
cmd = /bin/cat
args = 100.in
input = 100.in
output = 100.out
queue
cmd = /bin/cat
args = 101.in
input = 101.in
output = 101.out
queue

$ for i in $(seq 100 101); do echo "cmd = /bin/cat\nargs = $i.in\ninput = $i.in\noutput = $i.out\nqueue"; done | condor_submit
Submitting job(s)..
1 job(s) submitted to cluster 53.
1 job(s) submitted to cluster 54.

$ condor_q
-- Submitter: localhost.localdomain : <127.0.0.1:10003> : localhost.localdomain ID OWNER SUBMITTED RUN_TIME ST PRI SIZE CMD 53.0 matt 8/19 06:56 0+00:00:00 I 0 0.1 cat 100.in 54.0 matt 8/19 06:56 0+00:00:00 I 0 0.1 cat 101.in
2 jobs; 2 idle, 0 running, 0 held

$ condor_q
-- Submitter: localhost.localdomain : <127.0.0.1:10003> : localhost.localdomain ID OWNER SUBMITTED RUN_TIME ST PRI SIZE CMD
0 jobs; 0 idle, 0 running, 0 held

$ cat 100.out
hi
$ cat 101.out
bye

You get two clusters because you have multiple cmd/executable lines in the input to condor_submit. You can get around that if it is a problem.

Best,


matt

On 08/18/2010 10:05 PM, Thomas.Pagano@xxxxxxxx wrote:
I set up a job like (paraphrased)
output = cvfout_$(Process).txt
transfer_input_files = $(Process).7z, foo.exe
queue 100
Where I prepared a directory of data files 0.7z, 1.7z, 2.7z and so on.
It wasn't until my job was done that I realized that I made a typo and
actually wanted to run 150 jobs ("queue 150"). So jobs 0-99 finished but
100-149 didn't. I'd like to run those remaining jobs now without having
to rename/reorder all my files.
Is it possible for me to do something like
output = cvfout_$(Process+100).txt
transfer_input_files = $(Process+100).7z, foo.exe
queue 50
or say,
queue 100 to 150 step 1
or
blarg = `expr $(Process) + 100`
output = cvfout_$(blarg).txt
or
Set /A blarg=%Process%+100
_https://lists.cs.wisc.edu/archive/condor-users/2006-June/msg00261.shtml_ suggests
the process number is hard wired to start at zero but I'm wondering if I
can make a new variable?
Cheers,
Tom
Dr Thomas C. Pagano
CSIRO Land and Water
PO Box 56, Highett, VIC 3190
Phone 03 9252 6342
Mobile 04 5867 4721
Email Thomas.Pagano@xxxxxxxx



_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/condor-users/