Re: [Condor-users] process number to start higher than zero

[<Thomas.Pagano@xxxxxxxx>]

Matt, 

Thanks, my fallback was going to be writing a script to generate a large submit file that contained 50 copies of the same entry, somewhat like you suggest. Your RFE though sounds like an excellent idea though. 

Cheers,

Tom




-----Original Message-----
From: Matthew Farrellee [mailto:matt@xxxxxxxxxx] 
Sent: Thursday, 19 August 2010 9:02 PM
To: Condor-Users Mail List
Cc: Pagano, Tom (CLW, Highett)
Subject: Re: [Condor-users] process number to start higher than zero

Something like?

cmd = /bin/cat
args = $([100 + $(Process)]).in
input = $([100 + $(Process)]).in
output = $(Process).out
queue 51

It's still an RFE,

https://condor-wiki.cs.wisc.edu/index.cgi/tktview?tn=488

Until that is resolved, did you know condor_submit reads from stdin?

$ cat 100.in
hi
$ cat 101.in
bye

$ for i in $(seq 100 101); do echo "cmd = /bin/cat\nargs = $i.in\ninput 
= $i.in\noutput = $i.out\nqueue"; done
cmd = /bin/cat
args = 100.in
input = 100.in
output = 100.out
queue
cmd = /bin/cat
args = 101.in
input = 101.in
output = 101.out
queue

$ for i in $(seq 100 101); do echo "cmd = /bin/cat\nargs = $i.in\ninput 
= $i.in\noutput = $i.out\nqueue"; done | condor_submit
Submitting job(s)..
1 job(s) submitted to cluster 53.
1 job(s) submitted to cluster 54.

$ condor_q
-- Submitter: localhost.localdomain : <127.0.0.1:10003> : 
localhost.localdomain
  ID      OWNER            SUBMITTED     RUN_TIME ST PRI SIZE CMD 

   53.0   matt            8/19 06:56   0+00:00:00 I  0   0.1  cat 100.in 

   54.0   matt            8/19 06:56   0+00:00:00 I  0   0.1  cat 101.in 

2 jobs; 2 idle, 0 running, 0 held

$ condor_q
-- Submitter: localhost.localdomain : <127.0.0.1:10003> : 
localhost.localdomain
  ID      OWNER            SUBMITTED     RUN_TIME ST PRI SIZE CMD 

0 jobs; 0 idle, 0 running, 0 held

$ cat 100.out
hi
$ cat 101.out
bye

You get two clusters because you have multiple cmd/executable lines in 
the input to condor_submit. You can get around that if it is a problem.

Best,


matt

On 08/18/2010 10:05 PM, Thomas.Pagano@xxxxxxxx wrote:
> I set up a job like (paraphrased)
> output = cvfout_$(Process).txt
> transfer_input_files = $(Process).7z, foo.exe
> queue 100
> Where I prepared a directory of data files 0.7z, 1.7z, 2.7z and so on.
> It wasn't until my job was done that I realized that I made a typo and
> actually wanted to run 150 jobs ("queue 150"). So jobs 0-99 finished but
> 100-149 didn't. I'd like to run those remaining jobs now without having
> to rename/reorder all my files.
> Is it possible for me to do something like
> output = cvfout_$(Process+100).txt
> transfer_input_files = $(Process+100).7z, foo.exe
> queue 50
> or say,
> queue 100 to 150 step 1
> or
> blarg = `expr $(Process) + 100`
> output = cvfout_$(blarg).txt
> or
> Set /A blarg=%Process%+100
> _https://lists.cs.wisc.edu/archive/condor-users/2006-June/msg00261.shtml_ suggests
> the process number is hard wired to start at zero but I'm wondering if I
> can make a new variable?
> Cheers,
> Tom
> Dr Thomas C. Pagano
> CSIRO Land and Water
> PO Box 56, Highett, VIC 3190
> Phone 03 9252 6342
> Mobile 04 5867 4721
> Email Thomas.Pagano@xxxxxxxx
>
>
>
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/condor-users/