Re: [HTCondor-users] HTC and HPC

[Ines Dutra <ines@xxxxxxxxxxxx>]

I have been using Condor for many years to run thousands of experiments in machine learning. The evaluation methodology used in machine learning experiments require tuning of parameters and cross validation which can easily span thousands of processes, even when not using big data. So far, I am very happy with the results and the many resources I can use to run my experiments! So I would sign up the table "Who should be using HTCondor".

Best regards,

InÃs Dutra.

Dept of Radiology, UW-Madison, USA

on leave from Dept of Computer Science, University of Porto, Portugal

On Thu, Dec 4, 2014 at 3:06 PM, Miha Ahronovitz <myinnervoice@xxxxxxxxx> wrote:

This is an excellent question. After 34 years of Condor, tens of thousands of threads still there is no clarity of what HTCondor is and why using it,

A simple table stating, in two columns: "Who shoulld be using HTCondor", and "Who should not be using HTCondor"

Here is a quote fromÂbit.ly/1FhQTMZÂ

There is an acute need to transform the classical high performance computing (HPC) Âskill set. Adrian Cockroft, from Battery Ventures says in a recent interview with InsideHPC"

"The biggest skill shortage in IT today is related to big data and data scientists. Most people in HPC have the analysis and math skills needed to meet this need, but you may need to retool from being an MPI programmer to learning R or Hadoop or Spark."

Â

I would ad Mezos as well. Times have changed. So what is position of HTCondor today, relative to the newer products? Relative to Docker and the new arrival Rocket?

I think the top thinkers on this group should spend some time to position clearly where HTCondor fits and what unexplored poten tials this software has.

Cheers,

Miha Ahronovitz

--- --- --- --- --- --- --- --- --- --- --- --- ---

Miha Ahronovitz

PrincipalÂ|ÂAhrono Associates

Web:Âhttp://www.ahrono.com/

Blog:Âhttp://my-inner-voice.blogspot.com/

c:Â408 422 2757

e:Âmiha.ahronovitz@xxxxxxxxxx

tw:Â@myinnervoice

--- --- --- --- --- --- --- --- --- --- --- --- ---

On Thu, Dec 4, 2014 at 3:10 AM, marrodriguez <marc.rodriguez@xxxxxxxx> wrote:

Hi

Hi
I have interest to implement condor on my site, but I have a doubt, Why condor is consider a HTCÂ batch system and not HPC. it have some disadvantage on HPC field respect Slurm, PBS vs SGE?

Thanks in advanced
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@cs.wisc.edu with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/