Re: [HTCondor-users] 1 hour wall time for interactive jobs

[Todd Tannenbaum <tannenba@xxxxxxxxxxx>]

On 10/1/2019 1:38 PM, Rundblom, Glen wrote:
> Hello, I could use a little more help.
> 
> I added the line to my condor_config.local file for a specific compute 
> node, restarted condor, and then ran an interactive job for that compute 
> node, but it didnt get killed.
> 
> Is there a different config file I should have added the line to?
> 

The example Zach gave you below is for your submit node(s), not the compute (execute) node.

Zach's example also removed jobs after they were in the queue for 1 hour, regardless of how long they actually ran (i.e. a job that waits 30 min to get scheduled would be killed 30 min after it started).  Not sure this is what you wanted.

Anyhow, here is an example configuration for your compute (execute) nodes that will tell the execute node to kick off an interactive job that has run for more than 1 hour, and then have the kicked-off job go back into the queue on hold with an error message (that can be displayed with condor_q -hold):

   TIME_EXCEEDED = InteractiveJob =?= True && TotalJobRunTime > 3600
   PREEMPT = $(TIME_EXCEEDED)
   WANT_HOLD = $(TIME_EXCEEDED)
   WANT_HOLD_REASON = "Interactive job ran for more than one hour"

Warning: The above is off the top of my head, I didn't test it....

Hope the above helps
Todd


> Thank you again,
> 
> -Glen
> 
> ------------------------------------------------------------------------
> *From:* HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of 
> Rundblom, Glen <rundblom@xxxxxxxxxxxx>
> *Sent:* Monday, September 30, 2019 12:40 PM
> *To:* HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
> *Subject:* Re: [HTCondor-users] 1 hour wall time for interactive jobs
> Thank you Zach, I will give that a try!
> 
> 
> 
> ------------------------------------------------------------------------
> *From:* HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of 
> Zach Miller <zmiller@xxxxxxxxxxx>
> *Sent:* Monday, September 30, 2019 12:20 PM
> *To:* HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
> *Subject:* Re: [HTCondor-users] 1 hour wall time for interactive jobs
> Hi Glen,
> 
> There is an attribute called "InteractiveJob" that is set to "true" for 
> interactive jobs. I believe it's undefined otherwise.
> 
> So you could use something like this in your config file:
> 
> SYSTEM_PERIODIC_REMOVE = (InteractiveJob =?= True) && ( (CurrentTime - 
> QDate) > 3600)
> 
> 
> Cheers,
> -zach
> 
> 
> ïOn 9/30/19, 11:48 AM, "HTCondor-users on behalf of Rundblom, Glen" 
> <htcondor-users-bounces@xxxxxxxxxxx on behalf of rundblom@xxxxxxxxxxxx> 
> wrote:
> 
> 
>  ÂÂÂ Hello,
> 
>  ÂÂÂ I am trying to find the best way to implement a 1 hour time limit 
> to only interactive jobs.
> 
> 
>  ÂÂÂ I read that periodic_remove might be the setting I need to use, but 
> I am not sure how I would tie it to only interactive jobs.
> 
> 
> 
>  ÂÂÂ Thank you for your help,
>  ÂÂÂ -Glen
> 
> 
>  ÂÂÂ Glen Rundblom
>  ÂÂÂ Linux Systems Support Analyst
>  ÂÂÂ Engineering IT User Services: Research
>  ÂÂÂ College of Engineering
>  ÂÂÂ University of Illinois at Urbana-Champaign
>  ÂÂÂ 2312 Siebel Center
>  ÂÂÂ 217-244-8203
>  ÂÂÂ rundblom@xxxxxxxxxxxx 
> <https://webmail.illinois.edu/owa/redir.aspx?C=3JkOiIBJy0WnRbc6zvSjyPcoZysGyNEI6ax1nwwG6CJAg31_YqlaqyStt6VonZZpC78hGHj4T2Q.&URL=mailto%3arundblom%40illinois.edu>
> 
> 
> 
> 
> 
> 
> 
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> 
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/
> 
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> 
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/
> 


-- 
Todd Tannenbaum <tannenba@xxxxxxxxxxx> University of Wisconsin-Madison
Center for High Throughput Computing   Department of Computer Sciences
HTCondor Technical Lead                1210 W. Dayton St. Rm #4257
Phone: (608) 263-7132                  Madison, WI 53706-1685