[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] how to split a job



Sometimes it is better to think about splitting the data rather than the execution itself - you
therefore can run the same code over different parameter values, or different subsets of the data.
 
Whether this is possible, or whether it gives the same answer as doing it all in one go will
depend on the job itself.
 
There are many many scenarios for this, so some clues ast to what field you are working in would help.
 
Condor works at its best when handling many independent tasks (such as Monte Carlo or parameter
sweep). It can be used for closer-coupled MPI-style parallel tasks, but often HPCs or smaller clusters
are more appropriate for that.
 
Cheers
 
JK
-----Original Message-----
From: condor-users-bounces@xxxxxxxxxxx [mailto:condor-users-bounces@xxxxxxxxxxx]On Behalf Of Remon van Holstein
Sent: Thursday, October 04, 2007 1:27 PM
To: Condor-Users Mail List
Subject: Re: [Condor-users] how to split a job

Yes like big c and java source code

 


Van: condor-users-bounces@xxxxxxxxxxx [mailto:condor-users-bounces@xxxxxxxxxxx] Namens Simon Hammond
Verzonden: donderdag 4 oktober 2007 14:22
Aan: Condor-Users Mail List
Onderwerp: Re: [Condor-users] how to split a job

 

What kind of application is the "job" - is it one large source code program?

We'll probably need more detail on what you are trying to run before we can help.



Si Hammond
University of Warwick

On 04/10/2007, Remon van Holstein <Remon@xxxxxxxxxxxx> wrote:

Hey There,

 

How can I ,split up a job into small pieces, is there a program or what.

 

Can somebody help me

 

Thank you


_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/condor-users/