[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] 10.7.1 upgrade issue on central manager



Is there an alternate token that can be used in place of ActivationTimer that will allow us to check if a job has been running for at least 4 hours before considering preemption (among other checks)?

--Mike

On 8/22/23 14:09, Jaime Frey via HTCondor-users wrote:
In HTCondor 10.4.0, we took ActivationTimer and several other configuration parameters that were expressions used in building a desktop startd policy and moved them under a meta-knob so that theyâre not defined by default. You can restore them by adding this to your configuration:

use feature: POLICY_EXPR_FRAGMENTS

  - Jaime

On Aug 22, 2023, at 1:09 PM, Michael Thomas <wart@xxxxxxxxxxx> wrote:

Doh.  I don't know how I could have missed that.  Here's the expression in the config file:

PREEMPTION_REQUIREMENTS    = \
       ( ( $(ActivationTimer) > (4 * $(HOUR)) ) && \
         ( RemoteUserPrio > (1.2 * SubmittorPrio) ) && \
         ( RemoteUserPrio > 130 || $(ActivationTimer) > (24 * $(HOUR)))) || \
       ( TARGET.RemoteOwner =?= "boinc" ) || \
       ( ( SubmitterGroup =!= "<none>") && \
         ( SubmitterGroupResourcesInUse < SubmitterGroupQuota ) && \
         ( (RemoteGroup =?= "<none>" ) || \
           (RemoteGroupResourcesInUse > RemoteGroupQuota) ) )

So it appears that the 'ActivationTimer' variable is no longer present in 10.7.1, whereas on a 10.0.6 box it is defined as:


ActivationTimer = ifThenElse(JobStart =!= UNDEFINED, (time() - JobStart), 0)


--Mike

On 8/22/23 12:39, Marc W Mengel via HTCondor-users wrote:
In the error:
08/22/23 10:24:15 ERROR "Error parsing PREEMPTION_REQUIREMENTS
expression: ( (  > (4 * 3600) ) && ( RemoteUserPrio > (1.2 *
SubmittorPrio) ) && ( RemoteUserPrio > 130 ||  > (24 * 3600)) ) || (
TARGET.RemoteOwner =?= "boinc" ) || ( ( SubmitterGroup =!= "<none>") &&
( SubmitterGroupResourcesInUse < SubmitterGroupQuota ) && ( (RemoteGroup
=?= "<none>" ) || (RemoteGroupResourcesInUse > RemoteGroupQuota) ) )" at
line 714 in file
I think the problem in the expressions is the missing word before the greater than
signs in the subexpressions: "( > (4*3600))" and " > (24 * 3600)"  -- it looks like some sort of
parameter name (i.e. RemotWallClockTime or some such)  is missing?
--
Marc W. Mengel
Computer Services Senior Developer
Data Management and Applications
Fermi National Accelerator Laboratory
630 840 8256 office
www.fnal.gov
<https://email.fnal.gov/owa/redir.aspx?C=JkVsWjSyHEuWV2kFJWNPyC9OyMKf7dEIp_yxPk9yfhfadE3mdLfI6T8Ztf8BVaJjzoIe8oJ5H0M.&URL=http%3a%2f%2fwww.fnal.gov>
Connect with us!
Newsletter<https://email.fnal.gov/owa/redir.aspx?C=-29AtpIe40SAvGF4aiNr86KvVjap7dEIuxIdg8Q5bYa9sT7QTFVhxhVnl8zwXkEuBSuAQLRkEfg.&URL=http%3a%2f%2fwww.fnal.gov%2fpub%2ftoday> | Facebook<https://email.fnal.gov/owa/UrlBlockedError.aspx> | Twitter<https://email.fnal.gov/owa/redir.aspx?C=-29AtpIe40SAvGF4aiNr86KvVjap7dEIuxIdg8Q5bYa9sT7QTFVhxhVnl8zwXkEuBSuAQLRkEfg.&URL=https%3a%2f%2ftwitter.com%2fFermilabToday>
________________________________
From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of htcondor-users-request@xxxxxxxxxxx <htcondor-users-request@xxxxxxxxxxx>
Sent: Tuesday, August 22, 2023 12:00 PM
To: htcondor-users@xxxxxxxxxxx <htcondor-users@xxxxxxxxxxx>
Subject: HTCondor-users Digest, Vol 117, Issue 56
Send HTCondor-users mailing list submissions to
         htcondor-users@xxxxxxxxxxx
To subscribe or unsubscribe via the World Wide Web, visit
         https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.cs.wisc.edu_mailman_listinfo_htcondor-2Dusers&d=DwICAg&c=gRgGjJ3BkIsb5y6s49QqsA&r=mA4qFs7Hfq-joWhWXnsXfA&m=MFzYarVkGI0g1ZnJbe6LyWQj7e4kOO5M4UCNP8jESafrlOPZwbo4JLV9nEbM8t7h&s=YmApm1xjvk7d7WYhCKKpjOreldAXaI89E_DTvysJMag&e=
or, via email, send a message with subject or body 'help' to
         htcondor-users-request@xxxxxxxxxxx
You can reach the person managing the list at
         htcondor-users-owner@xxxxxxxxxxx
When replying, please edit your Subject line so it is more specific
than "Re: Contents of HTCondor-users digest..."
Today's Topics:
    1. 10.7.1 upgrade issue on central manager (Michael Thomas)
----------------------------------------------------------------------
Message: 1
Date: Tue, 22 Aug 2023 11:17:10 -0500
From: Michael Thomas <wart@xxxxxxxxxxx>
To: condor-users@xxxxxxxxxxx
Subject: [HTCondor-users] 10.7.1 upgrade issue on central manager
Message-ID: <990bcce3-862d-23ba-87a3-c6e9adf97116@xxxxxxxxxxx>
Content-Type: text/plain; charset=UTF-8; format=flowed
After upgrading from condor 10.0.6 to 10.7.1, the NegotiatorLog is
showing the following error and restarting:
08/22/23 10:24:15 ERROR "Error parsing PREEMPTION_REQUIREMENTS
expression: ( (  > (4 * 3600) ) && ( RemoteUserPrio > (1.2 *
SubmittorPrio) ) && ( RemoteUserPrio > 130 ||  > (24 * 3600)) ) || (
TARGET.RemoteOwner =?= "boinc" ) || ( ( SubmitterGroup =!= "<none>") &&
( SubmitterGroupResourcesInUse < SubmitterGroupQuota ) && ( (RemoteGroup
=?= "<none>" ) || (RemoteGroupResourcesInUse > RemoteGroupQuota) ) )" at
line 714 in file
/var/lib/condor/execute/slot1/dir_3638677/userdir/build-8VuVsN/BUILD/condor-10.7.1/src/condor_negotiator.V6/matchmaker.cpp
This was working fine on 10.0.6, so I'm not sure what might have changed
to trigger this error.  Is there a way to get more details about what it
doesn't like about this PREEMPTION_REQUIREMENTS setting?
--Mike
------------------------------
Subject: Digest Footer
_______________________________________________
HTCondor-users mailing list
HTCondor-users@xxxxxxxxxxx
https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.cs.wisc.edu_mailman_listinfo_htcondor-2Dusers&d=DwICAg&c=gRgGjJ3BkIsb5y6s49QqsA&r=mA4qFs7Hfq-joWhWXnsXfA&m=MFzYarVkGI0g1ZnJbe6LyWQj7e4kOO5M4UCNP8jESafrlOPZwbo4JLV9nEbM8t7h&s=YmApm1xjvk7d7WYhCKKpjOreldAXaI89E_DTvysJMag&e=
------------------------------
End of HTCondor-users Digest, Vol 117, Issue 56
***********************************************
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx<mailto:htcondor-users-request@xxxxxxxxxxx> with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/


_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/