Re: [Condor-users] Blocking Resources

["Sarnath K - ERS, HCLTech" <k_sarnath@xxxxxxx>]

Thank you Greg for the interesting pointers.

Parallel Universe does offer quite interesting features.

 

However, I don’t think it guarantees that my successive MPI jobs will re-use the same machines.

Is it possible to get that guarantee?

I am looking for the guarantee so that I can completely eliminate scheduling overhead.

 

I was just thinking if I could use a single “Job cluster” and run different processes one after another ( manually enforcing the wait)

I think I can do it easily with web-services. Not sure if I can get that with “condor_submit”.

Any thoughts?

“Job cluster” should guarantee ~zero scheduling overhead, Correct?

 

Thanks,

Best Regards,

Sarnath

 

From: condor-users-bounces@xxxxxxxxxxx [mailto:condor-users-bounces@xxxxxxxxxxx] On Behalf Of Greg Thain
Sent: Tuesday, July 10, 2012 11:12 PM
To: Condor-Users Mail List
Subject: Re: [Condor-users] Blocking Resources

 

Hi,

 

Is it possible to do the following using condor?

 

Block a few machines;

Use them for some jobs, say MPI jobs;

Release a subset (or) acquire more machines

Use them for some more jobs

Iterate like this before finally relinquishing all resources…

 

Can such a thing be possible with Condor?

You can do something pretty close to this with the parallel universe.

See the manual section "Condor's Dedicated Scheduling"

http://research.cs.wisc.edu/condor/manual/v7.8/3_12Setting_Up.html#SECTION004129000000000000000

for details on how to set this up.  The biggest difference from your request is that you can't release
a subset, you must release all of the machines allocated to your parallel job at once.  However, the
machines stay claimed by the schedd for a while, so if you release the machine, then request more within
a short time frame, the request should be serviced quickly.

-greg

 

::DISCLAIMER::
----------------------------------------------------------------------------------------------------------------------------------------------------

The contents of this e-mail and any attachment(s) are confidential and intended for the named recipient(s) only.
E-mail transmission is not guaranteed to be secure or error-free as information could be intercepted, corrupted,
lost, destroyed, arrive late or incomplete, or may contain viruses in transmission. The e mail and its contents
(with or without referred errors) shall therefore not attach any liability on the originator or HCL or its affiliates.
Views or opinions, if any, presented in this email are solely those of the author and may not necessarily reflect the
views or opinions of HCL or its affiliates. Any form of reproduction, dissemination, copying, disclosure, modification,
distribution and / or publication of this message without the prior written consent of authorized representative of
HCL is strictly prohibited. If you have received this email in error please delete it and notify the sender immediately.
Before opening any email and/or attachments, please check them for viruses and other defects.

----------------------------------------------------------------------------------------------------------------------------------------------------