[HTCondor-users] condor_adstash hard limit

["Hofsaess, Robin (ETP)" <robin.hofsaess@xxxxxxx>]

-------------------------------------------

$ condor_version
$CondorVersion: 9.1.2 Jul 29 2021 BuildID: 552044 PackageID: 9.1.2-1 $
$CondorPlatform: x86_64_CentOS7 $
-------------------------------------------

Hi everyone,

I have a question concerning condor_adstash:

We want to put our complete condor history into an elasticsearch DB with condor_adstash.

Therefore, we changed: https://github.com/htcondor/htcondor/blob/db44d1948122d10b98bf101acfbd67c3f109d8f1/src/condor_scripts/adstash/history.py#L68

history_iter = schedd.history(
                constraint="true",
                projection=[],
                match = -1,  # changed
                #match=min(10000, args.schedd_history_max_ads),
                since=since_str
            )

to get all entries, according to: https://htcondor.readthedocs.io/en/v8_8/apis/python-bindings/api/htcondor.html

But then, we experience a hard limit of 50000 entries per Schedd.

Does anyone know, where this limit comes from?

Can this be changed?

It seems that the HistoryIterator (https://github.com/htcondor/htcondor/blob/6809756bb368f8c77c4e1d17730addb0a0f9940d/src/python-bindings/schedd.cpp#L435) is the reason, as it only has 50000 entries. But I don't see any obvious limitation.

Thanks for your help!

Cheers,

Robin