[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Condor Win!



That's great.

Just one quick question - how did you submit the R jobs to Condor? We have done a similar thing (but not in the scale you have mentioned) using /usr/bin/rscript on the cluster nodes.

Regards
Arijit

Arijit Mukherjee
Senior Scientist R&D; Innovation Lab
Tata Consultancy Services
Ph:- 913366367137
Cell:- 9903705285
Mailto: mukherjee.arijit@xxxxxxx
Website:
http://www.tcs.com
____________________________________________
Experience certainty.        IT Services
                       Business Solutions
                       Consulting
____________________________________________




From:        "Dunn, George Jr" <dunng@xxxxxxxx>
To:        "htcondor-users@xxxxxxxxxxx" <htcondor-users@xxxxxxxxxxx>,
Date:        06/25/2013 08:31 PM
Subject:        [HTCondor-users] Condor Win!
Sent by:        htcondor-users-bounces@xxxxxxxxxxx




Hi All,
 
Just wanted to share a little success story.
 
We are a small public university that has been hit hard in both human and budget resources in recent years (as many schools have). We do have a research computing group but overall our IT is stretched so thin that most all of those folks are on fire duty. A group in our Statistics department was up against a runtime wall trying to run some R jobs in VM’s. There were a total of 8000 jobs that each took 12 hours  to complete (with unfettered access to a single core). By marshaling a few of our labs we were able to run over 1100 simultaneous jobs on 175 ish machines (mostly i7’s a few i5’s) even through several electrical storms that rebooted all the machines and caused all manner of networking errors IN TIME! She is going to add me to the Author list for the paper and we will put a blurb about Condor.
 
I hope this will be a proof of concept for a larger roll-out. I also plan to replace our torque scheduler for ROCKS with this for our mpi jobs.
 
Thank you for such a polished and stable product. I am a fan for life!!!
 
Thanks,
Eddie Dunn
Systems Administrator
Department of Computer Science
University of North Carolina Wilmington_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

=====-----=====-----=====
Notice: The information contained in this e-mail
message and/or attachments to it may contain
confidential or privileged information. If you are
not the intended recipient, any dissemination, use,
review, distribution, printing or copying of the
information contained in this e-mail message
and/or attachments to it are strictly prohibited. If
you have received this communication in error,
please notify us by reply e-mail or telephone and
immediately and permanently delete the message
and any attachments. Thank you