Mailing List Archives Public Access	UW Madison Computer Sciences Department Computer Systems Lab
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Condor-users] Example jobs don't start

Date: Wed, 21 Sep 2005 15:25:11 +0200
From: Nicolas GUIOT <nicolas.guiot@xxxxxxx>
Subject: Re: [Condor-users] Example jobs don't start
Right, merci :)

But quite surprisingly, there is absolutly no reason that "KeyboardIdle" stays equals to 0, since no one uses the keyboard...

Anyway, if I want, for a specific machine, that it doesn't watch the keyboard utilization, in which file should I tell it ? How ?

Thanks for your help
Nicolas
----------------
On Wed, 21 Sep 2005 07:32:11 -0500
"Thomas Materna" <materna@xxxxxxxxxxxxx> wrote:

> Hi Nicolas,
> 
> The reason shows in the output of condor_status -long:
> 
> The START condition requires KeyboardIdle > 15*60 , but KeyboardIdle is 0!
> That is the time since the keyboard was last used (in seconds). It seems
> that you keep using the keyboard. You can change the START expression to go
> around it. We have dedicated machine and so we don't car about keyboards,
> etc. I realized that the keyboardidle is not always that accurate,
> especially under windows.
> 
> Now about the 2 jobs running on the same machine: since they have 2 cpus,
> condor considers them as 2 different machines. Try to add this in your
> submit file:
> 
> Rank = (VirtualMachineId==1)
> 
> That way it will first start on the cpu number 1 of each machine and then
> only if there are more jobs, on the other one.
> 
> Bonne chance
> 
> Thomas
> 
> Cyclotron Institute, Texas A&M university
> ZIP 77843-3366
> (979)-845-1411 ext. 258
> 
> > -----Original Message-----
> > From: condor-users-bounces@xxxxxxxxxxx 
> > [mailto:condor-users-bounces@xxxxxxxxxxx] On Behalf Of Nicolas GUIOT
> > Sent: Wednesday, September 21, 2005 4:32
> > To: condor-users@xxxxxxxxxxx
> > Subject: [Condor-users] Example jobs don't start
> > 
> > Hi all
> > 
> > I just setup a condor pool, with 4 machines : 
> > io = central manager
> > vrubel, goya (bi-cpu) : execute machine
> > chagall : submit machine
> > 
> > I ran the example job : only N° 1 and 3 ran, the others just 
> > don't start, and I don't know why (well : machine rejected 
> > the job "because of their own requirements" : but which ?)
> > 
> > - I don't really understand why N° 1 and 3 ran on "vrubel", 
> > but nothing started on "goya"
> > 
> > - Is there a command to know for each machine, which criteria 
> > the job didn't complete ?
> > 
> > Thanks for your help (and sorry for the long mail, but the 
> > info should be here...)
> > 
> > _______________________________________
> > guiot@chagall$ condor_status
> > 
> > Name          OpSys       Arch   State      Activity   LoadAv 
> > Mem   ActvtyTime
> > 
> > vm1@xxxxxxxxx LINUX       INTEL  Owner      Idle       0.000  
> >  188  1+19:50:21
> > vm2@xxxxxxxxx LINUX       INTEL  Owner      Idle       0.000  
> >  188  1+19:50:22
> > vrubel.galaxy LINUX       INTEL  Claimed    Busy       0.000  
> >  250  0+00:11:46
> > 
> >                      Machines Owner Claimed Unclaimed Matched 
> > Preempting
> > 
> >          INTEL/LINUX        3     2       1         0       0 
> >          0
> > 
> >                Total        3     2       1         0       0 
> >          0
> > ______________________________________
> > 
> > $ condor_q -analyze
> > 
> > 
> > -- Submitter: chagall.galaxy.ibpc.fr : <193.49.27.24:48041> : 
> > chagall.galaxy.ibpc.fr
> >  ID      OWNER            SUBMITTED     RUN_TIME ST PRI SIZE CMD
> > ---
> > 002.000:  Run analysis summary.  Of 3 machines,
> >       0 are rejected by your job's requirements
> >       2 reject your job because of their own requirements
> >       1 match but are serving users with a better priority in the pool
> >       0 match but reject the job for unknown reasons
> >       0 match but will not currently preempt their existing job
> >       0 are available to run your job
> >         Last successful match: Wed Sep 21 04:37:51 2005
> >         Last failed match: Wed Sep 21 11:23:29 2005
> >         Reason for last match failure: no match found
> > ---
> > 004.000:  Request is being serviced
> > 
> > ---
> > 004.001:  Run analysis summary.  Of 3 machines,
> >       0 are rejected by your job's requirements
> >       2 reject your job because of their own requirements
> >       1 match but are serving users with a better priority in the pool
> >       0 match but reject the job for unknown reasons
> >       0 match but will not currently preempt their existing job
> >       0 are available to run your job
> >         No successful match recorded.
> >         Last failed match: Wed Sep 21 11:23:29 2005
> >         Reason for last match failure: no match found
> > ---
> > 004.002:  Run analysis summary.  Of 3 machines,
> >       0 are rejected by your job's requirements
> >       2 reject your job because of their own requirements
> >       1 match but are serving users with a better priority in the pool
> >       0 match but reject the job for unknown reasons
> >       0 match but will not currently preempt their existing job
> >       0 are available to run your job
> > ....
> > ______________________________________
> > guiot@chagall$ condor_status -l
> > MyType = "Machine"
> > TargetType = "Job"
> > Name = "vm1@xxxxxxxxxxxxxxxxxxx"
> > Machine = "goya.galaxy.ibpc.fr"
> > Rank = 0.000000
> > CpuBusy = ((LoadAvg - CondorLoadAvg) >= 0.500000) 
> > COLLECTOR_HOST_STRING = "io.galaxy.ibpc.fr"
> > CondorVersion = "$CondorVersion: 6.7.10 Aug  3 2005 $"
> > CondorPlatform = "$CondorPlatform: I386-LINUX_RH9 $"
> > VirtualMachineID = 1
> > VirtualMemory = 1048568
> > Disk = 2451806
> > CondorLoadAvg = 0.000000
> > LoadAvg = 0.000000
> > KeyboardIdle = 0
> > ConsoleIdle = 0
> > Memory = 188
> > Cpus = 1
> > StartdIpAddr = "<193.49.27.81:32772>"
> > Arch = "INTEL"
> > OpSys = "LINUX"
> > UidDomain = "galaxy.ibpc.fr"
> > FileSystemDomain = "galaxy.ibpc.fr"
> > Subnet = "193.49.27"
> > HasIOProxy = TRUE
> > TotalVirtualMemory = 2097136
> > TotalDisk = 4903612
> > TotalCpus = 2
> > TotalMemory = 376
> > KFlops = 138441
> > Mips = 504
> > LastBenchmark = 1127136637
> > TotalLoadAvg = 0.000000
> > TotalCondorLoadAvg = 0.000000
> > ClockMin = 680
> > ClockDay = 3
> > TotalVirtualMachines = 2
> > HasFileTransfer = TRUE
> > HasPerFileEncryption = TRUE
> > HasReconnect = TRUE
> > HasMPI = TRUE
> > HasTDP = TRUE
> > HasJICLocalConfig = TRUE
> > HasJICLocalStdin = TRUE
> > JavaVendor = "Sun Microsystems Inc."
> > JavaVersion = "1.4.2_05"
> > JavaMFlops = 49.363747
> > HasJava = TRUE
> > HasPVM = TRUE
> > HasRemoteSyscalls = TRUE
> > HasCheckpointing = TRUE
> > StarterAbilityList = 
> > "HasFileTransfer,HasPerFileEncryption,HasReconnect,HasMPI,HasT
> > DP,HasJICLocalConfig,HasJICLocalStdin,HasJava,HasPVM,HasRemote
> > Syscalls,HasCheckpointing"
> > CpuBusyTime = 0
> > CpuIsBusy = FALSE
> > TimeToLive = 2147483647
> > State = "Owner"
> > EnteredCurrentState = 1127136624
> > Activity = "Idle"
> > EnteredCurrentActivity = 1127136624
> > Start = ((KeyboardIdle > 15 * 60) && (((LoadAvg - 
> > CondorLoadAvg) <= 0.300000) || (State != "Unclaimed" && State 
> > != "Owner"))) Requirements = START MaxJobRetirementTime = 0 
> > CurrentRank = 0.000000 MonitorSelfTime = 1127294317 
> > MonitorSelfCPUUsage = 0.016666 MonitorSelfImageSize = 
> > 7060.000000 MonitorSelfResidentSetSize = 3380 MonitorSelfAge 
> > = 157710 DaemonStartTime = 1127136623 UpdateSequenceNumber = 
> > 526 MyAddress = "<193.49.27.81:32772>"
> > LastHeardFrom = 1127294445
> > UpdatesTotal = 521
> > UpdatesSequenced = 520
> > UpdatesLost = 2
> > UpdatesHistory = "0x00000000000000000000000000000000"
> > 
> > MyType = "Machine"
> > TargetType = "Job"
> > Name = "vm2@xxxxxxxxxxxxxxxxxxx"
> > Machine = "goya.galaxy.ibpc.fr"
> > Rank = 0.000000
> > CpuBusy = ((LoadAvg - CondorLoadAvg) >= 0.500000) 
> > COLLECTOR_HOST_STRING = "io.galaxy.ibpc.fr"
> > CondorVersion = "$CondorVersion: 6.7.10 Aug  3 2005 $"
> > CondorPlatform = "$CondorPlatform: I386-LINUX_RH9 $"
> > VirtualMachineID = 2
> > VirtualMemory = 1048568
> > Disk = 2451806
> > CondorLoadAvg = 0.000000
> > LoadAvg = 0.000000
> > KeyboardIdle = 0
> > ConsoleIdle = 0
> > Memory = 188
> > Cpus = 1
> > StartdIpAddr = "<193.49.27.81:32772>"
> > Arch = "INTEL"
> > OpSys = "LINUX"
> > UidDomain = "galaxy.ibpc.fr"
> > FileSystemDomain = "galaxy.ibpc.fr"
> > Subnet = "193.49.27"
> > HasIOProxy = TRUE
> > TotalVirtualMemory = 2097136
> > TotalDisk = 4903612
> > TotalCpus = 2
> > TotalMemory = 376
> > KFlops = 138441
> > Mips = 504
> > LastBenchmark = 1127136637
> > TotalLoadAvg = 0.000000
> > TotalCondorLoadAvg = 0.000000
> > ClockMin = 680
> > ClockDay = 3
> > TotalVirtualMachines = 2
> > HasFileTransfer = TRUE
> > HasPerFileEncryption = TRUE
> > HasReconnect = TRUE
> > HasMPI = TRUE
> > HasTDP = TRUE
> > HasJICLocalConfig = TRUE
> > HasJICLocalStdin = TRUE
> > JavaVendor = "Sun Microsystems Inc."
> > JavaVersion = "1.4.2_05"
> > JavaMFlops = 49.363747
> > HasJava = TRUE
> > HasPVM = TRUE
> > HasRemoteSyscalls = TRUE
> > HasCheckpointing = TRUE
> > StarterAbilityList = 
> > "HasFileTransfer,HasPerFileEncryption,HasReconnect,HasMPI,HasT
> > DP,HasJICLocalConfig,HasJICLocalStdin,HasJava,HasPVM,HasRemote
> > Syscalls,HasCheckpointing"
> > CpuBusyTime = 0
> > CpuIsBusy = FALSE
> > TimeToLive = 2147483647
> > State = "Owner"
> > EnteredCurrentState = 1127136624
> > Activity = "Idle"
> > EnteredCurrentActivity = 1127136624
> > Start = ((KeyboardIdle > 15 * 60) && (((LoadAvg - 
> > CondorLoadAvg) <= 0.300000) || (State != "Unclaimed" && State 
> > != "Owner"))) Requirements = START MaxJobRetirementTime = 0 
> > CurrentRank = 0.000000 MonitorSelfTime = 1127294317 
> > MonitorSelfCPUUsage = 0.016666 MonitorSelfImageSize = 
> > 7060.000000 MonitorSelfResidentSetSize = 3380 MonitorSelfAge 
> > = 157710 DaemonStartTime = 1127136623 UpdateSequenceNumber = 
> > 526 MyAddress = "<193.49.27.81:32772>"
> > LastHeardFrom = 1127294446
> > UpdatesTotal = 522
> > UpdatesSequenced = 521
> > UpdatesLost = 0
> > UpdatesHistory = "0x00000000000000000000000000000000"
> > 
> > MyType = "Machine"
> > TargetType = "Job"
> > Name = "vrubel.galaxy.ibpc.fr"
> > Machine = "vrubel.galaxy.ibpc.fr"
> > Rank = 0.000000
> > CpuBusy = ((LoadAvg - CondorLoadAvg) >= 0.500000) 
> > COLLECTOR_HOST_STRING = "io.galaxy.ibpc.fr"
> > CondorVersion = "$CondorVersion: 6.7.10 Aug  3 2005 $"
> > CondorPlatform = "$CondorPlatform: I386-LINUX_RH9 $"
> > VirtualMachineID = 1
> > ExecutableSize = 12161
> > JobUniverse = 1
> > NiceUser = FALSE
> > ImageSize = 7208
> > VirtualMemory = 1051900
> > Disk = 4992980
> > CondorLoadAvg = 0.000000
> > LoadAvg = 0.000000
> > KeyboardIdle = 3116
> > ConsoleIdle = 155033
> > Memory = 250
> > Cpus = 1
> > StartdIpAddr = "<193.49.27.11:32772>"
> > Arch = "INTEL"
> > OpSys = "LINUX"
> > UidDomain = "galaxy.ibpc.fr"
> > FileSystemDomain = "galaxy.ibpc.fr"
> > Subnet = "193.49.27"
> > HasIOProxy = TRUE
> > TotalVirtualMemory = 1051900
> > TotalDisk = 4992980
> > TotalCpus = 1
> > TotalMemory = 250
> > KFlops = 97422
> > Mips = 496
> > LastBenchmark = 1127270034
> > TotalLoadAvg = 0.000000
> > TotalCondorLoadAvg = 0.000000
> > ClockMin = 680
> > ClockDay = 3
> > TotalVirtualMachines = 1
> > HasFileTransfer = TRUE
> > HasPerFileEncryption = TRUE
> > HasReconnect = TRUE
> > HasMPI = TRUE
> > HasTDP = TRUE
> > HasJICLocalConfig = TRUE
> > HasJICLocalStdin = TRUE
> > JavaVendor = "Sun Microsystems Inc."
> > JavaVersion = "1.4.2_05"
> > JavaMFlops = 47.434353
> > HasJava = TRUE
> > HasPVM = TRUE
> > HasRemoteSyscalls = TRUE
> > HasCheckpointing = TRUE
> > StarterAbilityList = 
> > "HasFileTransfer,HasPerFileEncryption,HasReconnect,HasMPI,HasT
> > DP,HasJICLocalConfig,HasJICLocalStdin,HasJava,HasPVM,HasRemote
> > Syscalls,HasCheckpointing"
> > CpuBusyTime = 0
> > CpuIsBusy = FALSE
> > TimeToLive = 2147483647
> > State = "Claimed"
> > EnteredCurrentState = 1127278383
> > Activity = "Busy"
> > EnteredCurrentActivity = 1127293754
> > Start = ((KeyboardIdle > 15 * 60) && (((LoadAvg - 
> > CondorLoadAvg) <= 0.300000) || (State != "Unclaimed" && State 
> > != "Owner"))) Requirements = START MaxJobRetirementTime = 0 
> > CurrentRank = 0.000000 RemoteUser = "condor@xxxxxxxxxxxxxx"
> > RemoteOwner = "condor@xxxxxxxxxxxxxx"
> > ClientMachine = "chagall.galaxy.ibpc.fr"
> > JobId = "4.0"
> > GlobalJobId = "chagall.galaxy.ibpc.fr#1127137022#4.0"
> > JobStart = 1127293754
> > LastPeriodicCheckpoint = 1127293754
> > TotalJobRunTime = 706
> > TotalClaimRunTime = 15761
> > TotalClaimSuspendTime = 306
> > MonitorSelfTime = 1127294388
> > MonitorSelfCPUUsage = 0.266182
> > MonitorSelfImageSize = 7212.000000
> > MonitorSelfResidentSetSize = 3652
> > MonitorSelfAge = 157457
> > DaemonStartTime = 1127136944
> > UpdateSequenceNumber = 590
> > MyAddress = "<193.49.27.11:32772>"
> > LastHeardFrom = 1127294460
> > UpdatesTotal = 586
> > UpdatesSequenced = 585
> > UpdatesLost = 3
> > UpdatesHistory = "0x00000000000000000000000000000010"
> > ________________________________________
> > guiot@chagall:/ibpc/io/condor/condor-6.7.10/examples$ condor_q
> > 
> > 
> > -- Submitter: chagall.galaxy.ibpc.fr : <193.49.27.24:48041> : 
> > chagall.galaxy.ibpc.fr
> >  ID      OWNER            SUBMITTED     RUN_TIME ST PRI SIZE CMD
> >    2.0   condor          9/19 15:36   1+07:16:33 I  0   11.8 
> > env.remote foo bar
> >    4.0   condor          9/19 15:37   0+12:59:54 R  0   11.9 
> > loop.remote 200
> >    4.1   condor          9/19 15:37   0+00:00:00 I  0   11.9 
> > loop.remote 200
> >    4.2   condor          9/19 15:37   0+00:00:00 I  0   11.9 
> > loop.remote 300
> >    4.3   condor          9/19 15:37   0+00:00:00 I  0   11.9 
> > loop.remote 300
> >    4.4   condor          9/19 15:37   0+00:00:00 I  0   11.9 
> > loop.remote 500
> >    5.0   condor          9/19 15:37   0+00:00:00 I  0   11.9 
> > registers.remote
> >    6.0   condor          9/19 15:37   0+00:00:00 I  0   12.1 
> > reader.remote
> >    7.0   condor          9/19 15:37   0+00:00:00 I  0   12.1 
> > printer.remote
> >    8.0   condor          9/19 15:38   0+00:00:00 I  0   12.1 
> > fortIO.remote
> >    9.0   condor          9/19 15:38   0+00:00:00 I  0   0.0  
> > sh_loop 60
> > 
> > 11 jobs; 10 idle, 1 running, 0 held
> > guiot@chagall$ condor_q -l
> > 
> > 
> > -- Submitter: chagall.galaxy.ibpc.fr : <193.49.27.24:48041> : 
> > chagall.galaxy.ibpc.fr MyType = "Job"
> > TargetType = "Machine"
> > ClusterId = 2
> > QDate = 1127136987
> > CompletionDate = 0
> > Owner = "condor"
> > LocalUserCpu = 0.000000
> > LocalSysCpu = 0.000000
> > RemoteUserCpu = 0.000000
> > RemoteSysCpu = 0.000000
> > ExitStatus = 0
> > NumCkpts = 0
> > NumRestarts = 0
> > NumSystemHolds = 0
> > CommittedTime = 0
> > TotalSuspensions = 0
> > CumulativeSuspensionTime = 0
> > ExitBySignal = FALSE
> > CondorVersion = "$CondorVersion: 6.7.10 Aug  3 2005 $"
> > CondorPlatform = "$CondorPlatform: I386-LINUX_RH9 $"
> > RootDir = "/"
> > Iwd = "/ibpc/io/condor/condor-6.7.10/examples"
> > JobUniverse = 1
> > Cmd = "/ibpc/io/condor/condor-6.7.10/examples/env.remote"
> > MinHosts = 1
> > WantRemoteSyscalls = TRUE
> > WantCheckpoint = TRUE
> > RemoteSpoolDir = "/scratch/condor/spool/cluster2.proc0.subproc0"
> > JobPrio = 0
> > User = "condor@xxxxxxxxxxxxxx"
> > NiceUser = FALSE
> > MaxJobRetirementTime = 0
> > Env = "alpha=a;bravo=b;charlie=c"
> > JobNotification = 2
> > WantRemoteIO = TRUE
> > UserLog = "/ibpc/io/condor/condor-6.7.10/examples/env.log"
> > CoreSize = 0
> > KillSig = "SIGTSTP"
> > Rank = 0.000000
> > In = "/dev/null"
> > TransferIn = FALSE
> > Out = "env.out"
> > StreamOut = FALSE
> > Err = "env.err"
> > StreamErr = FALSE
> > BufferSize = 524288
> > BufferBlockSize = 32768
> > ShouldTransferFiles = "NO"
> > TransferFiles = "NEVER"
> > ImageSize = 12131
> > ExecutableSize = 12131
> > DiskUsage = 12131
> > Requirements = (Arch == "INTEL") && (OpSys == "LINUX") && 
> > ((CkptArch == Arch) || (CkptArch =?= UNDEFINED)) && 
> > ((CkptOpSys == OpSys) || (CkptOpSys =?= UNDEFINED)) && (Disk 
> > >= DiskUsage) && ((Memory * 1024) >= ImageSize) 
> > FileSystemDomain = "galaxy.ibpc.fr"
> > PeriodicHold = FALSE
> > PeriodicRelease = FALSE
> > PeriodicRemove = FALSE
> > OnExitHold = FALSE
> > OnExitRemove = TRUE
> > LeaveJobInQueue = FALSE
> > Args = "foo bar glarch"
> > GlobalJobId = "chagall.galaxy.ibpc.fr#1127136987#2.0"
> > ProcId = 0
> > JobStartDate = 1127138695
> > LastMatchTime = 1127270271
> > NumJobMatches = 4
> > OrigMaxHosts = 1
> > JobLastStartDate = 1127270275
> > JobCurrentStartDate = 1127275393
> > JobRunCount = 22
> > LastJobLeaseRenewal = 1127277906
> > RemoteWallClockTime = 112593.000000
> > LastRemoteHost = "vrubel.galaxy.ibpc.fr"
> > LastClaimId = "<193.49.27.11:32772>#1127136932#13"
> > CurrentHosts = 0
> > JobStatus = 1
> > EnteredCurrentStatus = 1127280509
> > LastSuspensionTime = 0
> > MaxHosts = 1
> > WantMatchDiagnostics = TRUE
> > LastRejMatchReason = "no match found"
> > LastRejMatchTime = 1127294309
> > ServerTime = 1127294486
> > 


-----------------------------------------------
CNRS - UPR 9080 : Laboratoire de Biochimie Theorique
Institut de Biologie Physico Chimique
13 rue Pierre et Marie Curie
75005 PARIS - FRANCE

Tel : +33 158 41 51 70
Fax : +33 158 41 50 26
------------------------------------------------
Follow-Ups:
- Re: [Condor-users] Example jobs don't start
  - From: Thomas Materna
References:
- [Condor-users] Example jobs don't start
  - From: Nicolas GUIOT
- Re: [Condor-users] Example jobs don't start
  - From: Thomas Materna
Prev by Date: Re: [Condor-users] Example jobs don't start
Next by Date: Re: [Condor-users] Globus - GT 4.0.1: GLOBUS_SCRATCH_DIR problem?
Previous by thread: Re: [Condor-users] Example jobs don't start
Next by thread: Re: [Condor-users] Example jobs don't start
Index(es):
- Date
- Thread
Mailing List Archives

Public Access

Re: [Condor-users] Example jobs don't start
