[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Condor-users] jobs with dependencies
- Date: Mon, 1 Nov 2004 06:51:03 +0000
- From: Michael Thon <mthon@xxxxxxxx>
- Subject: [Condor-users] jobs with dependencies
I am setting up a small condor pool of linux machines for life science
computing and I need some configuration advice. I need to keep a directory
of files (blast databases for the blastall app) on each execution node in
sync with the directory on the master node. Previous advice from others in
the mailing list suggested that I use local copies of these files rather than
a shared file system for performance reasons. I can use rsync to ensure that
the local copy is syncronized with the master. The master directory could
change on a daily basis so I need to ensure that it is synced before a
blastall job is run. therefore, I need to run rsync before every blastall
job. I see two ways of doing this:
a) submit an rsync job and create a dependency somehow that prevents blastall
job from running on the node unless the rsync job completes successfully.
Don't know how to do this but I'm sure it must be supported and documented
somewhere. This would also require that rsync job and blastall job run on
the same node.
b) create a job that actually runs two applications. This would require some
kind of wrapper script around the two apps.