[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[HTCondor-users] Python bindings: Jobs held - Hold reason: Spooling input data files



Hi,

I'm unable to submit jobs to my (local) SCHEED via Python interface.
All my jobs immediately enter HELD state (Hold reason: Spooling input data files).
I've checked all HTCondor log files but I don't see anything suspicious.
Also I can submit jobs via command line.

This is my Python script:

import htcondor
import classad

schedd = htcondor.Schedd()
ad_job = classad.ClassAd({"Cmd": "/bin/sh", "Arguments": "-c 'echo Hello World && sleep 1m'"})
ad_results = []
cluster = schedd.submit(ad_job, 1, True, ad_results)

Based on:
https://research.cs.wisc.edu/htcondor/HTCondorWeek2013/presentations/Bockelman_Python.pdf
https://research.cs.wisc.edu/htcondor/manual/v8.2/6_7Python_Bindings.html

And this is the condor_q output:

[root@lukas tmp]# condor_q -better

-- Schedd: lukas : <137.226.128.99:57810>
---
041.000:  Request is held.

Hold reason: Spooling input data files

User priority for apache@lukas is not available, attempting to analyze without it.
---
041.000:  Run analysis summary.  Of 16 machines,
      0 are rejected by your job's requirements
      0 reject your job because of their own requirements
      0 match and are already running your jobs
      0 match but are serving other users
     16 are available to run your job

The Requirements _expression_ for your job is:

    true && TARGET.OPSYS == "LINUX" && TARGET.ARCH == "X86_64" &&
    TARGET.HasFileTransfer && TARGET.Disk >= RequestDisk &&
    TARGET.Memory >= RequestMemory

Your job defines the following attributes:

    DiskUsage = 1
    ImageSize = 100
    RequestDisk = 1
    RequestMemory = 1

The Requirements _expression_ for your job reduces to these conditions:

         Slots
Step    Matched  Condition
-----  --------  ---------
[1]          16  TARGET.OPSYS == "LINUX"
[3]          16  TARGET.ARCH == "X86_64"
[5]          16  TARGET.HasFileTransfer
[7]          16  TARGET.Disk >= RequestDisk
[9]          16  TARGET.Memory >= RequestMemory

Suggestions:

    Condition                         Machines Matched    Suggestion
    ---------                         ----------------    ----------
1   TARGET.OPSYS == "LINUX"           16                  
2   TARGET.ARCH == "X86_64"           16                  
3   TARGET.HasFileTransfer            16                  
4   TARGET.Disk >= 1                  16                  
5   TARGET.Memory >= ifthenelse(MemoryUsage isnt undefined,MemoryUsage,1)
                                      16

I've tried to disable the spool flag. But when I set spool=false, the job is not submitted to SCHEED at all...

Best regards,
Lukas