[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[HTCondor-users] Jobs staying idle, need to set the default memory in HTCondor-CE



Greetings,
Iâm using a small one-node cluster for testing purposes.
Iâm unable to run successfully Glidein jobs when the node has only 2GB or less.

The jobs submitted, Glideins, have the following required memory (min required) that is minimal
ImageSize = 100
ImageSize_RAW = 100
RequestMemory = ifthenelse(MemoryUsage =!= undefined,MemoryUsage,(ImageSize + 1023) / 1024)

But the router defaults in /usr/share/condor-ce/condor_ce_router_defaults kick in and specifically the expression
    eval_set_OriginalMemory = ifThenElse(maxMemory isnt undefined,
                                         maxMemory,
                                         ifThenElse(default_maxMemory isnt undefined,
                                                    default_maxMemory,
                                                    2000));
In JOB_ROUTER_DEFAULTS_GENERATED @=jrd

This set the required memory to 2000 and the job cannot start on the local condor because of the Machine requirements:
Requirements = START && (WithinResourceLimits)
WithinResourceLimits = (MY.Cpus > 0 && TARGET.RequestCpus <= MY.Cpus && MY.Memory > 0 && TARGET.RequestMemory <= MY.Memory && MY.Disk > 0 && TARGET.RequestDisk <= MY.Disk && (TARGET.RequestGPUs =?= undefined || MY.GPUs >= TARGET.RequestGPUs))

Is there a way I could change the default_maxMemory by adding the value in a config file?

set_default_maxMemory works within a routing policy but  Iâd like to avoid to write custom routing policies if possible. 
And Iâd prefer not to edit /usr/share/condor-ce/condor_ce_router_defaults 

Thank you,
Marco