[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] submitting issues when having huge transfer_input_files lists



On 4/14/23 04:47, Henning Fehrmann wrote:
Hello,


Is this behavior expected? Can we circumvent this?
Do we need to provide more information?


Hi Henning:

A 8 Megabyte list of transfer file is ... rather large. Is there anyway the list can be shortened? HTCondor can be instructed to transfer a whole directory, recursively, which would help a lot. Note that the problem in this case isn't the size of the files to be transferred, but their description.

-greg