[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] Condor with Ec2



Hi William,

I for one am interested in more details of your aproach.

Getting our Condor cluster to dynamicly expand into EC2 space has been
in my queue for a while, and may finally be getting back to the top.

My thoughts such as they've been is to have an external agent that
watches the queue and determines (through magic?) when new AMIs should
be spawned ( i'm thinking shutdown logic should probably live on the
AMI so it's tied to the billing cycle ), with the AMI mostly a generic
resource like our other cluster nodes (using GCB for communication).

-Jon


On Wed, Dec 03, 2008 at 07:41:47PM -0500, William Henry wrote:
:
:FYI,
:
:I posted a couple of articles about using Condor with EC2:
:
:First just using Condor to start an AMI:
:http://ipbabble.com/2008/11/mrg-grid-and-ec2.html
:
:Second using Condor and some new hooks to schedule jobs in an AMI in EC2:
:http://ipbabble.com/2008/12/mrg-and-ec2-enhanced.html
:
:Not all the details are here. There are some settings needed for the Enhanced (2nd option).
:
:Let me know if any of you would like those or if you think I should post a more exhaustive example on the blog.
:
:
:Best,
:William Henry
:Red Hat, MRG (http://www.redhat.com/mrg)
:_______________________________________________
:Condor-users mailing list
:To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
:subject: Unsubscribe
:You can also unsubscribe by visiting
:https://lists.cs.wisc.edu/mailman/listinfo/condor-users
:
:The archives can be found at: 
:https://lists.cs.wisc.edu/archive/condor-users/