[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Are flocking jobs considered remote jobs?



Hello,Â

We do use flocking but didn't encounter the issue where jobs stdout/stderr taking space in SPOOL.

It can happen because of the reason mentioned in the following thread.Â

https://www-auth.cs.wisc.edu/lists/htcondor-users/2015-May/msg00007.shtml

Thanks & Regards,
Vikrant Aggarwal


On Thu, Apr 7, 2022 at 12:28 AM Jacek Kominek via HTCondor-users <htcondor-users@xxxxxxxxxxx> wrote:
Hi,

We run into an issue today where our submit node run out of storage
space, which killed schedd. It turns out that the culprit was a couple
of job subdirectories under '/var/lib/condor/spool/' and it seems that
these were submitted as flocking jobs to another pool. The manual states
in various places that the SPOOL dir contains both input and output
files from remote jobs and we wonder if that could be the case here? If
so, a second question is whether flocking jobs can be configured so that
thee outputs are written directly to the user's folder where they were
submitted from, or do they always have to go through the SPOOL?

Of course, one solution is to move SPOOL to a different location on our
end that will not run out of space, and just might end up doing that,
but it would be good to know how it is supposed to work regardless.

Thanks in advance,

Best,

-Jacek

--
Jacek Kominek, PhD
University of Wisconsin-Madison
1552 University Avenue, Wisconsin Energy Institute 4154 Madison, WI
53726-4084, USA
jkominek@xxxxxxxx

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/