[Condor-users] Job Idle but resource free

[Massimo Canonico <canonico@xxxxxxxxxxxxx>]

Hi,
I have a cluster of 32 nodes, with red hat 7.2 OS and condor 6.6.5.

In the last three day we have had some problem with electrical energy of 
the cluster, but always condor was able to continue the jobs using the 
checkpoints when the energy come back.

But yesterday the electrical energy of the cluster went down at least 
three times, I had to do the manual fsck in the master node. From 
yesterday, only 8 nodes have my job running. The other 23 machines 
remain in the idle status.


What can I do?

At the end of this mail there is the output of condor_status.

Thanks,
   Massimo.

Name          OpSys       Arch   State      Activity   LoadAv Mem   
ActvtyTime

now01.nowdoma LINUX       INTEL  Unclaimed  Idle       0.050   752  
0+02:05:04
now02.nowdoma LINUX       INTEL  Claimed    Busy       1.000   752  
0+08:18:51
now03.nowdoma LINUX       INTEL  Claimed    Busy       1.000   752  
0+08:17:50
now04.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752  
0+00:06:17
now06.nowdoma LINUX       INTEL  Claimed    Busy       1.000   752  
0+07:01:42
now07.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now08.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now09.nowdoma LINUX       INTEL  Claimed    Busy       1.000   752  
0+06:27:43
now10.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now11.nowdoma LINUX       INTEL  Claimed    Busy       1.000   752  
0+06:59:21
now12.nowdoma LINUX       INTEL  Claimed    Busy       1.000   752  
0+06:59:14
now13.nowdoma LINUX       INTEL  Claimed    Busy       1.000   752  
0+07:07:48
now14.nowdoma LINUX       INTEL  Claimed    Busy       1.000   752  
0+07:13:19
now15.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now16.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now17.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now18.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now19.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now20.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now21.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now22.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now23.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now24.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now25.nowdoma LINUX       INTEL  Unclaimed  Idle       0.010   752[?????]
now26.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now27.nowdoma LINUX       INTEL  Unclaimed  Idle       0.010   752[?????]
now28.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now29.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now30.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now31.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]
now32.nowdoma LINUX       INTEL  Unclaimed  Idle       0.000   752[?????]

                    Machines Owner Claimed Unclaimed Matched Preempting

        INTEL/LINUX       31     0       8        23       0          0

              Total       31     0       8        23       0          0