[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] JobRouter unable to find job_queue.log when it's not in the spool directory



Ugh. Did you actually try it?
I thought I did, but then I tried again this morning and now it works. Sorry about that, and thanks for the help!

Vlad



On 03/31/16 12:02, Todd Tannenbaum wrote:
On 3/31/2016 9:54 AM, Vladimir Brik wrote:
SPOOL = /var/lib/condor/execute/spool
JOB_QUEUE_LOG = /ssd/job_queue.log
You could then do
JOB_ROUTER_SCHEDD1_SPOOL = /ssd
This seems to break file spooling, since condor_ce_schedd still puts
spool directories in /var/lib/condor/execute/spool but JobRouter is
looking for them in /ssd.


Vlad


Ugh.  Did you actually try it?  If so, could you post the snippets
showing the errors from your JobRouter log file ?

thanks
Todd



On 03/30/16 16:37, Todd Tannenbaum wrote:
On 3/30/2016 3:30 PM, Vladimir Brik wrote:
Hello.

After setting condor-ce's JOB_QUEUE_LOG to a location outside of SPOOL
(so that job_queue.log is not clobbered if the spool filesystem fills
up), JobRouter started to complain about being unable to open
$(SPOOL)/job_queue.log.

I see a config knob to tell JobRouter where the spool directory is, but
not where the job_queue.log file is. Is it possible to make JobRouter
work with job_queue.log that is outside of the spool directory?

I am using condor 8.3.8.

Thanks,

Vlad

Hi Vlad,

I am not a JobRouter expert, but I think you can make things work with
v8.3.8 if you still called the file "job_queue.log", even if it now
lives in a different subdirectory than SPOOL.

I think the trick is to use JOB_ROUTER_SCHEDD1_SPOOL knob (and
optionally also the JOB_ROUTER_SCHEDD2_SPOOL knob, depending on if you
are routing between two different schedds).   These knobs are documented
in the v8.3.8 manual at http://is.gd/VZs8fi

So I am guessing that  if you have something like
   SPOOL = /var/lib/condor/execute/spool
   JOB_QUEUE_LOG = /ssd/job_queue.log
You could then do
   JOB_ROUTER_SCHEDD1_SPOOL = /ssd

Hope the above helps
Todd


_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx
with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx
with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/