Re: [HTCondor-users] HTCondor 8.2.4 Released

[Tom Downes <tpdownes@xxxxxxxxxxxxxxxxxxxx>]

Hi Brian (and Condor Team):

The release notes say

The RPM and Debian distributions no longer include a configuration
file called condor_config.local, as this file is reserved for the use
of local administration. And,condor_install or condor_configure no
longer create file condor_config.local; they instead append to
condor_config. (Ticket #4552).

I'm not sure this statement captures what an admin needs to be doing.

FWIW, I agree with the switch to config.d - I've already done it
myself. But I think that a major change to local configuration file
management is out of keeping with the generally conservative approach
that Condor takes to stable branch minor point releases. There are
changes in 8.3 which would improve my ability to run my cluster which
are waiting until 8.4 in keeping with this approach.

--
Tom Downes
Associate Scientist and Data Center Manager
Center for Gravitation, Cosmology and Astrophysics
University of Wisconsin-Milwaukee
414.229.2678


On Mon, Nov 17, 2014 at 3:51 PM, Brian Bockelman <bbockelm@xxxxxxxxxxx> wrote:
> Not exactly -
>
> /etc/condor/condor_config.local is %config(noreplace) in older versions, but the intent was to remove it completely in 8.2.4.  When a %config(noreplace) file is removed from the RPM itself, it'll be renamed to .rpmsave (differs from the upgrade).  This has the side-effect of un-setting anything the admin has set locally.
>
> What should have been done is any custom contents of condor_config.local should have been migrated to /etc/condor/config.d as part of post-install trigger script.
>
> As I mentioned in the upstream ticket (ahem, before the release ;) ):
>
> https://htcondor-wiki.cs.wisc.edu/index.cgi/tktview?tn=4552
>
> OSG also tried to remove condor_config.local for our HTCondor RPM and did the same thing as was done in 8.2.4.  OSG was sufficiently burned by this same mistake that we added it back.
>
> To some extent, this is a last part of pulling off the band-aid in migrating from single monolithic files to the more RPM-like config.d directory.  To make it even more modern, we ought to move condor_config to a non-/etc directory.  Toward that goal, for HTCondor-CE, we have this in condor_config:
>
> LOCAL_CONFIG_DIR = /usr/share/condor-ce/config.d,/etc/condor-ce/config.d
>
> This way, we ship any defaults in /usr/share/condor-ce/config.d/; admins can edit anything in /etc/condor-ce/config.d without worrying about it getting changed on upgrade.  Fedora is trying to get packages to swim toward the goal of being able to boot with an empty /etc:
>
> http://0pointer.net/blog/projects/stateless.html
>
> (still a long way to go, of course; packages should still write well-documented example files in /etc.)
>
> Brian
>
>> On Nov 17, 2014, at 2:26 PM, Tom Downes <tpdownes@xxxxxxxxxxxxxxxxxxxx> wrote:
>>
>> Condor Team:
>>
>> Here's the problem (you want the files marked as %config(noreplace)
>> which is 0<<1 + 0<<4):
>>
>> [tpdownes@ldas-grid ~]$ rpm -qc --qf '[%{filenames}: %{fileflags}\n]'
>> condor | grep 17
>> /etc/condor/condor_config: 17
>> /etc/condor/condor_config.local: 17
>> [tpdownes@ldas-grid ~]$ rpm -qc --qf '[%{filenames}: %{fileflags}\n]'
>> -p condor-8.2.4-281203.rhel6.5.x86_64.rpm  | grep 17
>> warning: condor-8.2.4-281203.rhel6.5.x86_64.rpm: Header V4 RSA/SHA1
>> Signature, key ID 670079f6: NOKEY
>> /etc/condor/condor_config: 17
>>
>> --
>> Tom Downes
>> Associate Scientist and Data Center Manager
>> Center for Gravitation, Cosmology and Astrophysics
>> University of Wisconsin-Milwaukee
>> 414.229.2678
>>
>>
>> On Mon, Nov 17, 2014 at 2:04 PM, Brian Bockelman <bbockelm@xxxxxxxxxxx> wrote:
>>>
>>>> On Nov 17, 2014, at 1:15 PM, Dimitri Maziuk <dmaziuk@xxxxxxxxxxxxx> wrote:
>>>>
>>>> On 11/14/2014 08:28 AM, Laurent Wandrebeck wrote:
>>>>
>>>>> Just noticed rpm package for rhel 6 renamed every condor_config.local to
>>>>> condor_config.local.rpmsave, thus breaking a bit our pool
>>>>
>>>> After a discussion on this list I went through our pool and reverted all
>>>> condor_config and condor_config.local's to what's shipped with the rpm.
>>>>
>>>> I moved the actual config files into /etc/condor/config.d: 10_pool.conf,
>>>> 20_local.conf, 30_cron.conf. Most importantly, 10_pool.conf ("global"
>>>> config for all nodes) starts with
>>>> LOCAL_CONFIG_FILE = /dev/null
>>>> -- this way condor_config.local will not override anything in config.d
>>>
>>> Ah, clever!  I'm going to take this idea and move it to our local setup - we've had issues with condor_config.local too.
>>>
>>> Brian
>>> _______________________________________________
>>> HTCondor-users mailing list
>>> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
>>> subject: Unsubscribe
>>> You can also unsubscribe by visiting
>>> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>>>
>>> The archives can be found at:
>>> https://lists.cs.wisc.edu/archive/htcondor-users/
>> _______________________________________________
>> HTCondor-users mailing list
>> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
>> subject: Unsubscribe
>> You can also unsubscribe by visiting
>> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>>
>> The archives can be found at:
>> https://lists.cs.wisc.edu/archive/htcondor-users/
>
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/