[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] removing phantom jobs



I found a solution that works but is very slow :-(
Looks like condor_rm won't work on large clusters so I have a Perl script doing a condor_rm on each of the 90,000 individually.
Taking a long time but should complete overnight.

--Russell

> -----Original Message-----
> From: condor-users-bounces@xxxxxxxxxxx [mailto:condor-users-
> bounces@xxxxxxxxxxx] On Behalf Of Smithies, Russell
> Sent: Thursday, 22 July 2010 12:37 p.m.
> To: 'Condor-Users Mail List'
> Subject: [Condor-users] removing phantom jobs
> 
> I've had a user submit ~90,000 jobs and the whole Condor system seems to
> have gone haywire.
> It won't let anyone remove them and they all show as running but when you
> check the status of the nodes, they aren't.
> I've had to be a bit drastic and restarted all the condor processes on the
> masrter and the nodes but I still get this huge lost of idle and running
> jobs when I check the queue.
> I assume there's a file that needs deleted somewhere to fix this, anyone
> know which one?
> 
> We're still running an old version as we're expecting new hardware any day
> now  :-)
> 
> $CondorVersion: 6.8.6 Sep 13 2007 $
> $CondorPlatform: I386-LINUX_RHEL3 $
> 
> 
> Thanx,
> 
> Russell
> 
> =======================================================================
> Attention: The information contained in this message and/or attachments
> from AgResearch Limited is intended only for the persons or entities
> to which it is addressed and may contain confidential and/or privileged
> material. Any review, retransmission, dissemination or other use of, or
> taking of any action in reliance upon, this information by persons or
> entities other than the intended recipients is prohibited by AgResearch
> Limited. If you have received this message in error, please notify the
> sender immediately.
> =======================================================================
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
> 
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/condor-users/