[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] Matlab Distributed Computing Engine and Condor



Bill and others,

Thanks for your responses.

We have the Matlab Distributed Computing Enginer and toolboxes and can
run our MATLAB, Simulink, optimizations, etc on its default job manger.
What I wanted to do was expand our MATLAB ad-hoc LAN cluster (not sure
of the terminology) so that it could be used for MAYA render jobs as
well as C++ compiled executables without using MATLAB to submit the
jobs.  I was interested in Condor because someone had written a Maya
interface to it and it was open-source.

MATLAB has an interface for third party schedulers but they may function
with some limitations compared to their own job manager.

http://www.mathworks.com/access/helpdesk/help/toolbox/distcomp/index.htm
l?/access/helpdesk/help/toolbox/distcomp/bqur7ev-35.html&http://www.math
works.com/products/distribtb/supported/sched/ 

Replacing the MATLAB job manager with Condor is one option.  The second
option is to have the Matlab job manager and Condor share the workers.  

>From what I read, I believe that Condor has the ability to be made aware
when jobs are executing on a MATLAB worker and not to submit jobs to
those workers.  This is interesting because this could possibly allow
the best of both worlds.

Best regards,
Allan


-----Original Message-----
From: condor-users-bounces@xxxxxxxxxxx
[mailto:condor-users-bounces@xxxxxxxxxxx] On Behalf Of Bill Taylor
Sent: Saturday, February 23, 2008 5:30 PM
To: Condor-Users Mail List
Subject: Re: [Condor-users] Matlab Distributed Computing Engine and
Condor

Allan,

Our general suggestion is to run a few jobs and make sure you have your
application doing what you want and then to use the Matlab compiler to
set yourself up with a license free application which can run anywhere.
We then let Condor handle the submission and handling of the data out to
our cluster.

We usually create a DAG and submit the Dag with Dagman to ensure that we
can restart it if some had issues and failed without redoing all of
them.

We keep a copy of the Matlab compiler runtime on a shared file system
that all the nodes can see and simply move the data needed for each job.

We have not had a need to look at their tool. I fired up a job on
Wednesday for a department here and we had run 2,400 jobs by about the
same time the next day.

Hope this helps some.

Bill
Condor Team



Baker, Allan wrote:
>
> Hi.
>
> I am evaluating whether I can use Condor as a job manager for the 
> MATLAB Distributed Computing Engine from The Mathworks.  I have not 
> used Condor before.
>
> Has anyone attempted to do this before?
>
> Any guidance or lessons learned from the user community would be 
> appreciated.
>
> Best Regards,
> Allan
>
> ----------------------------------------------------------------------
> ------------
> Allan R. Baker
> Systems Engineer Staff - Guidance & Navigation *Lockheed Martin 
> Missiles and Fire Control - Dallas* allan.baker@xxxxxxxx 972.603.7621
>
> ----------------------------------------------------------------------
> --
>
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx 
> with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
> The archives can be found at: 
> https://lists.cs.wisc.edu/archive/condor-users/
>   


_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with
a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

The archives can be found at: 
https://lists.cs.wisc.edu/archive/condor-users/