[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] bug in logrotation



yep,

right always good to have a second pair of eyes :) 

It was not only the day but also around the time of day I stumbled into this !!! (+ it does not take much to confuse me :( ) 

Have a splendid weekend I owe you a pitcher :)  

-- 
Christoph Beyer
DESY Hamburg
IT-Department

Notkestr. 85
Building 02b, Room 009
22607 Hamburg

phone:+49-(0)40-8998-2317
mail: christoph.beyer@xxxxxxx

----- UrsprÃngliche Mail -----
Von: "Zach Miller" <zmiller@xxxxxxxxxxx>
An: "htcondor-users" <htcondor-users@xxxxxxxxxxx>
Gesendet: Freitag, 22. November 2019 19:24:52
Betreff: Re: [HTCondor-users] bug in logrotation

Hi Cristoph,

I figured out what happened based on the config and logs you sent me offline:

In November of 2017 you ran a bunch of jobs and had the MAX_STARTER_LOG set to 10MB.  The logs actually DID rotate then in November 2017.

Then, you changed your MAX_STARTER_LOG to 1GB, and have literally accumulated 2 years of job history.

So everything is working as expected.  It just looked odd because by sheer coincidence, it was exactly 2 years to the DAY that the rotation happened!

(This also explains the other issue, which I will comment on in that thread)


Cheers,
-zach


ïOn 11/22/19, 10:58 AM, "HTCondor-users on behalf of Zach Miller" <htcondor-users-bounces@xxxxxxxxxxx on behalf of zmiller@xxxxxxxxxxx> wrote:

    Hi Cristoph,
    
    Strange...
    
    Can you double check the contents of a couple of these?  What are the timestamps for the first and last lines in each of slot1_10 and slot1_10.old, for example?  It seems odd to me that the current ones are so much bigger than the .old ones. (I would expect the reverse...).
    
    Are you seeing any messages in these logs about log rotation failing?
    
    What size (or time) do you have configured for rotation?
    
    Thanks!
    
    
    Cheers,
    -zach
    
    
    On 11/22/19, 8:56 AM, "HTCondor-users on behalf of Beyer, Christoph" <htcondor-users-bounces@xxxxxxxxxxx on behalf of christoph.beyer@xxxxxxx> wrote:
    
        Hi,
        
        we loose somehow two years here in terms of timestamp: 
        
        The logs add up OK but they get a 2017 timestamp instead of 2019 for some reason ? 
        
        -rw-r--r-- 1 condor it    355041416 22. Nov 15:46 StarterLog.slot1_1
        -rw-r--r-- 1 condor it    340927634 22. Nov 15:49 StarterLog.slot1_10
        -rw-r--r-- 1 condor it     10485981 22. Nov 2017  StarterLog.slot1_10.old
        -rw-r--r-- 1 condor it    341932295 22. Nov 15:46 StarterLog.slot1_11
        -rw-r--r-- 1 condor it     10486020 22. Nov 2017  StarterLog.slot1_11.old
        -rw-r--r-- 1 condor it    333737263 22. Nov 15:45 StarterLog.slot1_12
        -rw-r--r-- 1 condor it     10486050 23. Nov 2017  StarterLog.slot1_12.old
        -rw-r--r-- 1 condor it    337051744 22. Nov 15:49 StarterLog.slot1_13
        -rw-r--r-- 1 condor it     10486050 22. Nov 2017  StarterLog.slot1_13.old
        -rw-r--r-- 1 condor it    330326345 22. Nov 15:47 StarterLog.slot1_14
        -rw-r--r-- 1 condor it     10486050 23. Nov 2017  StarterLog.slot1_14.old
        -rw-r--r-- 1 condor it    326301507 22. Nov 15:44 StarterLog.slot1_15
        -rw-r--r-- 1 condor it     10486050 22. Nov 2017  StarterLog.slot1_15.old
        -rw-r--r-- 1 condor it    329685561 22. Nov 15:46 StarterLog.slot1_16
        -rw-r--r-- 1 condor it     10486050 22. Nov 2017  StarterLog.slot1_16.old
        -rw-r--r-- 1 condor it    319505243 22. Nov 15:46 StarterLog.slot1_17
        -rw-r--r-- 1 condor it     10486050 23. Nov 2017  StarterLog.slot1_17.old
        
        this is on 
        
        [root@bird664 condor]# condor_master -v
        $CondorVersion: 8.7.8 May 31 2018 BuildID: 442130 $
        $CondorPlatform: x86_64_RedHat6 $
        
        Best
        christoph
        
        -- 
        Christoph Beyer
        DESY Hamburg
        IT-Department
        
        Notkestr. 85
        Building 02b, Room 009
        22607 Hamburg
        
        phone:+49-(0)40-8998-2317
        mail: christoph.beyer@xxxxxxx
        _______________________________________________
        HTCondor-users mailing list
        To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
        subject: Unsubscribe
        You can also unsubscribe by visiting
        https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
        
        The archives can be found at:
        https://lists.cs.wisc.edu/archive/htcondor-users/
        
    
    
    _______________________________________________
    HTCondor-users mailing list
    To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
    subject: Unsubscribe
    You can also unsubscribe by visiting
    https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
    
    The archives can be found at:
    https://lists.cs.wisc.edu/archive/htcondor-users/


_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/