Re: [Condor-users] A question about two submit points

[jun wang <wjun_ott@xxxxxxx>]

Hi Zach,

Thanks for the very useful information. Now I can only schedule jobs from two schedds with similar speed by defining different subsets of machines for each queue. But if I use the same set of machines for both schedds(I suppose Condor should support scheduling jobs from both schedds using the set of machines), even I use different user names or accocunting groups, Condor always schedule jobs from one of the schedds, and few from another. By the way, my application is like:

- one Java application use BirdBath SOAP API to submit 256 identical jobs to a schedd on the same first machine;

- another same Java application use BirdBath SOAP API to submit 256 same jobs to another schedd on the same second machine simultaneously;

- all jobs requests are submitted to the schedds through multiple clusters each of which has 32 jobs;

- the two schedds are in different NT domains;

- all job requests from both schedds define the same set of 32 machines to run; Note: if the schedds define two different subsets of machines to run here, then the scheduling speeds from two schedds are similar.

Any idea? Many thanks.

Another question is when I use condor_userprio to set priority values or delete a accounting group, the output said the operation has been done, but when I use this command to check again even after a long period of time, their contents are still same which mean my operations do not work. By the way, I run this command on a worker machine not the Central manager.

Any idea on this question? Thanks.

Cheers,
Jun 

> Date: Tue, 28 Jul 2009 15:42:27 -0500
> From: zmiller@xxxxxxxxxxx
> To: condor-users@xxxxxxxxxxx
> Subject: Re: [Condor-users] A question about two submit points
>
> On Tue, Jul 28, 2009 at 03:32:34PM +0000, jun wang wrote:
> > Hi All,
> >
> > I did a test to submit jobs from two machines and expect they will be scheduled
> > to execute at a roughly similar speed each. But Condor always pick up jobs from
> > one queue to run in most time and pick up only few jobs from another queue. I
> > tried to increase the priority of the jobs in the second queue, but there is no
> > difference.
>
> let me try to clarify how this works. first, the job priority only matters
> within a single schedd, so this will not do what you wish. second, condor
> schedules jobs and assigns priority based on the owner of the job. i'm
> guessing in this case, the jobs have the same owner in both schedds.
>
>
> here's two simple options:
>
> 1) use accounting groups. jobs submitted to schedd A and schedd B should then
> have different accounting groups.
> http://www.cs.wisc.edu/condor/manual/v7.2/3_4User_Priorities.html#24080
>
> -or-
>
> 2) submit the jobs as a different user to each schedd. then they will be
> prioritized equally.
>
>
> if you opt for #1 (which i would probably recommend), you can also use
> SUBMIT_EXPRS in the config files to do this automatically for you:
> http://www.cs.wisc.edu/condor/manual/v7.2/3_3Configuration.html#18955
>
>
> please let me know if i can help further. thanks!
>
>
> cheers,
> -zach
>
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/condor-users/

---

Windows Live™ Hotmail®: Celebrate the moment with your favorite sports pics. Check it out.