[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Condor-users] trouble enabling history for condorview



Hi,
I am trying to set up a condorview server on my central manager.
my central manager is running linux centos 5 and condor 7.0.3.
when I enable history and define the history directory on my central
manager the collector starts crashing.
no history files are created.
does anybody know why this is happening?

This is what I get in the masterlog:

5/27 09:58:10 ******************************************************
5/27 09:58:10 ** condor_master (CONDOR_MASTER) STARTING UP
5/27 09:58:10 ** /opt/condor-7.0.3/sbin/condor_master
5/27 09:58:10 ** $CondorVersion: 7.0.3 Jun 20 2008 BuildID: 91405 $
5/27 09:58:10 ** $CondorPlatform: I386-LINUX_RHEL5 $
5/27 09:58:10 ** PID = 8037
5/27 09:58:10 ** Log last touched 5/27 09:58:10
5/27 09:58:10 ******************************************************
5/27 09:58:10 Using config source: /opt/condor-7.0.3/etc/condor_config
5/27 09:58:10 Using local config sources:
5/27 09:58:10    /opt/condor-7.0.3/local.somaster/condor_config.local
5/27 09:58:10 DaemonCore: Command Socket at <172.24.0.9:34431>
5/27 09:58:10 Started DaemonCore process
"/opt/condor-7.0.3/sbin/condor_collector", pid and pgroup = 22676
5/27 09:58:13 Started DaemonCore process
"/opt/condor-7.0.3/sbin/condor_negotiator", pid and pgroup = 22681
5/27 09:58:13 Started DaemonCore process
"/opt/condor-7.0.3/sbin/condor_schedd", pid and pgroup = 22682
5/27 09:58:13 Started DaemonCore process
"/opt/condor-7.0.3/sbin/condor_startd", pid and pgroup = 22683
5/27 10:06:10 The COLLECTOR (pid 22676) exited with status 4
5/27 10:06:10 Sending obituary for "/opt/condor-7.0.3/sbin/condor_collector"
5/27 10:06:10 restarting /opt/condor-7.0.3/sbin/condor_collector in 10 seconds
5/27 10:06:10 attempt to connect to <172.24.0.9:9618> failed:
Connection refused (connect errno = 111).
5/27 10:06:10 ERROR: SECMAN:2003:TCP connection to <172.24.0.9:9618> failed

5/27 10:06:10 Failed to start non-blocking update to <172.24.0.9:9618>.
5/27 10:06:20 Started DaemonCore process
"/opt/condor-7.0.3/sbin/condor_collector", pid and pgroup = 23034
5/27 10:14:20 The COLLECTOR (pid 23034) exited with status 4
5/27 10:14:20 Sending obituary for "/opt/condor-7.0.3/sbin/condor_collector"
5/27 10:14:20 restarting /opt/condor-7.0.3/sbin/condor_collector in 10 seconds
5/27 10:14:20 attempt to connect to <172.24.0.9:9618> failed:
Connection refused (connect errno = 111).
5/27 10:14:20 ERROR: SECMAN:2003:TCP connection to <172.24.0.9:9618> failed

this is what I get in the collectorlog:

5/27 09:58:10 ** condor_collector (CONDOR_COLLECTOR) STARTING UP
5/27 09:58:10 ** /opt/condor-7.0.3/sbin/condor_collector
5/27 09:58:10 ** $CondorVersion: 7.0.3 Jun 20 2008 BuildID: 91405 $
5/27 09:58:10 ** $CondorPlatform: I386-LINUX_RHEL5 $
5/27 09:58:10 ** PID = 22676
5/27 09:58:10 ** Log last touched 5/27 09:58:08
5/27 09:58:10 ******************************************************
5/27 09:58:10 Using config source: /opt/condor-7.0.3/etc/condor_config
5/27 09:58:10 Using local config sources:
5/27 09:58:10    /opt/condor-7.0.3/local.somaster/condor_config.local
5/27 09:58:10 DaemonCore: Command Socket at <172.24.0.9:9618>
5/27 09:58:10 In ViewServer::Init()
5/27 09:58:10 In CollectorDaemon::Init()
5/27 09:58:10 In ViewServer::Config()
5/27 09:58:10 In CollectorDaemon::Config()
5/27 09:58:10 enable: Creating stats hash table
5/27 09:58:10 Configuration: SAMPLING_INTERVAL=60,
MAX_STORAGE=10000000, MaxFileSize=333333,
POOL_HISTORY_DIR=/export/condor-history
5/27 09:58:10 FileName=/export/condor-history/viewhist0.0.old , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist0.0.new , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist0.1.old , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist0.1.new , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist0.2.old , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist0.2.new , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist1.0.old , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist1.0.new , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist1.1.old , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist1.1.new , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist1.2.old , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist1.2.new , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist2.0.old , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist2.0.new , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist2.1.old , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist2.1.new , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist2.2.old , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist2.2.new , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist3.0.old , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist3.0.new , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist3.1.old , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist3.1.new , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist3.2.old , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist3.2.new , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist4.0.old , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist4.0.new , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist4.1.old , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist4.1.new , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist4.2.old , StartTime=-1
5/27 09:58:10 FileName=/export/condor-history/viewhist4.2.new , StartTime=-1
5/27 09:58:14 (Sending 0 ads in response to query)
5/27 09:58:14 Got QUERY_STARTD_PVT_ADS
5/27 09:58:14 (Sending 0 ads in response to query)
5/27 09:58:14 NegotiatorAd  : Inserting ** "< somaster >"
5/27 09:58:14 stats: Inserting new hashent for
'Negotiator':'somaster':'172.24.0.9'
5/27 09:58:14 Got QUERY_STARTD_ADS
5/27 09:58:14 (Sending 0 ads in response to query)
5/27 09:58:15 Got QUERY_STARTD_ADS
5/27 09:58:15 (Sending 0 ads in response to query)
5/27 09:58:16 Got QUERY_STARTD_ADS
5/27 09:58:16 (Sending 0 ads in response to query)
5/27 09:58:16 Got QUERY_STARTD_ADS
5/27 09:58:16 (Sending 0 ads in response to query)
5/27 09:58:17 Got QUERY_STARTD_ADS
5/27 09:58:17 (Sending 0 ads in response to query)
5/27 09:58:17 Got QUERY_STARTD_ADS
5/27 09:58:17 (Sending 0 ads in response to query)
5/27 09:58:17 Got QUERY_STARTD_ADS
5/27 09:58:17 (Sending 0 ads in response to query)
5/27 09:58:18 MasterAd     : Inserting ** "< somaster >"
5/27 09:58:18 stats: Inserting new hashent for 'Master':'somaster':'172.24.0.9'
5/27 09:58:18 Got QUERY_STARTD_ADS
5/27 09:58:18 (Sending 0 ads in response to query)
5/27 09:58:18 ScheddAd     : Inserting ** "< somaster , 172.24.0.9 >"
5/27 09:58:18 stats: Inserting new hashent for 'Schedd':'somaster':'172.24.0.9'
5/27 09:58:18 DaemonCore: Can't receive command request from
172.24.0.9 (perhaps a timeout?)
5/27 09:58:18 SubmittorAd  : Inserting ** "< soroka@somastersomaster ,
172.24.0.9 >"
5/27 09:58:18 stats: Inserting new hashent for
'Submittor':'soroka@somaster':'172.24.0.9'
5/27 09:58:18 SubmittorAd  : Inserting ** "< SOAR@somastersomaster ,
172.24.0.9 >"
5/27 09:58:18 stats: Inserting new hashent for
'Submittor':'SOAR@somaster':'172.24.0.9'
5/27 09:58:18 Got QUERY_STARTD_ADS
5/27 09:58:18 (Sending 0 ads in response to query)
5/27 09:58:19 Got QUERY_STARTD_ADS
5/27 09:58:19 (Sending 0 ads in response to query)
5/27 09:58:19 Got QUERY_STARTD_ADS
5/27 09:58:19 (Sending 0 ads in response to query)
5/27 09:58:19 Got QUERY_STARTD_ADS
5/27 09:58:19 (Sending 0 ads in response to query)
5/27 09:58:20 Got QUERY_STARTD_ADS
5/27 09:58:20 (Sending 0 ads in response to query)
5/27 09:58:20 Got QUERY_STARTD_ADS
5/27 09:58:20 (Sending 0 ads in response to query)
5/27 09:58:21 Got QUERY_STARTD_ADS
5/27 09:58:21 (Sending 0 ads in response to query)
5/27 09:58:27 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243406907:5, failing.
5/27 09:58:30 StartdAd     : Inserting ** "< somaster , 172.24.0.9 >"
5/27 09:58:30 stats: Inserting new hashent for 'Start':'somaster':'172.24.0.9'
5/27 09:58:30 StartdPvtAd  : Inserting ** "< somaster , 172.24.0.9 >"
5/27 09:58:30 stats: Inserting new hashent for
'StartdPvt':'somaster':'172.24.0.9'
5/27 09:58:32 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243406912:6, failing.
5/27 09:58:41 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243406921:7, failing.
5/27 09:58:45 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243406925:8, failing.
5/27 09:58:50 WARNING:  No master ad for <
CLASS11361DSK08.soroka.clalit.org.il >
5/27 09:58:50 ScheddAd     : Inserting ** "<
CLASS11361DSK08.soroka.clalit.org.il , 172.24.35.101 >"
5/27 09:58:50 stats: Inserting new hashent for
'Schedd':'CLASS11361DSK08.soroka.clalit.org.il':'172.24.35.101'
5/27 09:59:03 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243406943:9, failing.
5/27 09:59:06 Got QUERY_STARTD_ADS
5/27 09:59:06 (Sending 1 ads in response to query)
5/27 09:59:09 Got QUERY_STARTD_ADS
5/27 09:59:09 (Sending 1 ads in response to query)
5/27 09:59:10 Got QUERY_STARTD_ADS
5/27 09:59:10 (Sending 1 ads in response to query)
5/27 09:59:11 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243406953:10, failing.
5/27 09:59:15 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243407255:32, failing.
5/27 09:59:25 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243407266:34, failing.
5/27 09:59:29 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243407269:35, failing.
5/27 09:59:29 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243407269:36, failing.
5/27 09:59:32 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243406979:12, failing.
5/27 09:59:33 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243406978:11, failing.
5/27 09:59:33 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243407273:37, failing.
5/27 09:59:36 StartdAd     : Inserting ** "<
CLASS11361DSK08.soroka.clalit.org.il , 172.24.35.101 >"
5/27 09:59:36 stats: Inserting new hashent for
'Start':'CLASS11361DSK08.soroka.clalit.org.il':'172.24.35.101'
5/27 09:59:36 StartdPvtAd  : Inserting ** "<
CLASS11361DSK08.soroka.clalit.org.il , 172.24.35.101 >"
5/27 09:59:36 stats: Inserting new hashent for
'StartdPvt':'CLASS11361DSK08.soroka.clalit.org.il':'172.24.35.101'
5/27 09:59:37 WARNING:  No master ad for <
CLASS11350DSK12.soroka.clalit.org.il >
5/27 09:59:37 ScheddAd     : Inserting ** "<
CLASS11350DSK12.soroka.clalit.org.il , 172.24.35.102 >"
5/27 09:59:37 stats: Inserting new hashent for
'Schedd':'CLASS11350DSK12.soroka.clalit.org.il':'172.24.35.102'
5/27 09:59:38 WARNING:  No master ad for <
CLASS11354DSK01.soroka.clalit.org.il >
5/27 09:59:38 ScheddAd     : Inserting ** "<
CLASS11354DSK01.soroka.clalit.org.il , 172.24.34.113 >"
5/27 09:59:38 stats: Inserting new hashent for
'Schedd':'CLASS11354DSK01.soroka.clalit.org.il':'172.24.34.113'
5/27 09:59:43 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243407283:38, failing.
5/27 09:59:44 Got QUERY_STARTD_ADS
5/27 09:59:44 (Sending 2 ads in response to query)
5/27 09:59:45 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243407285:39, failing.
5/27 09:59:49 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243407289:41, failing.
5/27 09:59:49 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243407289:40, failing.
5/27 09:59:52 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243407292:42, failing.
5/27 10:00:23 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243407323:43, failing.
5/27 10:00:28 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243407327:44, failing.
5/27 10:00:30 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243407330:45, failing.
5/27 10:00:30 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243407330:46, failing.
5/27 10:00:32 Got QUERY_STARTD_ADS
5/27 10:00:32 (Sending 2 ads in response to query)
5/27 10:00:35 DC_AUTHENTICATE: attempt to open invalid session
somaster:22262:1243407335:48, failing.
5/27 10:00:44 MasterAd     : Inserting ** "<
CLASS11359DSK06.soroka.clalit.org.il >"
5/27 10:00:44 stats: Inserting new hashent for
'Master':'CLASS11359DSK06.soroka.clalit.org.il':'172.24.35.105'
5/27 10:00:51 DC_AUTHENTICATE: attempt to open invalid session
somaster:22597:1243407350:1, failing.
5/27 10:00:53 DC_AUTHENTICATE: attempt to open invalid session
somaster:22597:1243407352:2, failing.
5/27 10:00:54 ScheddAd     : Inserting ** "<
CLASS11359DSK06.soroka.clalit.org.il , 172.24.35.105 >"
5/27 10:00:54 stats: Inserting new hashent for
'Schedd':'CLASS11359DSK06.soroka.clalit.org.il':'172.24.35.105'
5/27 10:00:54 DC_AUTHENTICATE: attempt to open invalid session
somaster:22597:1243407354:3, failing.
5/27 10:00:56 Got QUERY_STARTD_ADS
5/27 10:00:56 (Sending 2 ads in response to query)
5/27 10:00:57 Got QUERY_STARTD_ADS
5/27 10:00:57 (Sending 2 ads in response to query)
5/27 10:00:58 Got QUERY_STARTD_ADS
5/27 10:00:58 (Sending 2 ads in response to query)
5/27 10:00:58 Got QUERY_STARTD_ADS
5/27 10:00:58 (Sending 2 ads in response to query)
5/27 10:00:59 DC_AUTHENTICATE: attempt to open invalid session
somaster:22597:1243407359:4, failing.
5/27 10:00:59 Got QUERY_STARTD_ADS
5/27 10:00:59 (Sending 2 ads in response to query)
5/27 10:00:59 Got QUERY_STARTD_ADS
5/27 10:00:59 (Sending 2 ads in response to query)
5/27 10:01:00 Got QUERY_STARTD_ADS
5/27 10:01:00 (Sending 2 ads in response to query)
5/27 10:01:00 Got QUERY_STARTD_ADS
5/27 10:01:00 (Sending 2 ads in response to query)
5/27 10:01:00 Got QUERY_STARTD_ADS
5/27 10:01:00 (Sending 2 ads in response to query)
5/27 10:01:01 DC_AUTHENTICATE: attempt to open invalid session
somaster:22597:1243407361:5, failing.
5/27 10:01:01 Got QUERY_STARTD_ADS
5/27 10:01:01 (Sending 2 ads in response to query)
5/27 10:01:01 Got QUERY_STARTD_ADS
5/27 10:01:01 (Sending 2 ads in response to query)
5/27 10:01:02 Got QUERY_STARTD_ADS
5/27 10:01:02 (Sending 2 ads in response to query)
5/27 10:01:03 Got QUERY_STARTD_ADS
5/27 10:01:03 (Sending 2 ads in response to query)
5/27 10:01:04 Got QUERY_STARTD_ADS
5/27 10:01:04 (Sending 2 ads in response to query)
5/27 10:01:04 Got QUERY_STARTD_ADS
5/27 10:01:04 (Sending 2 ads in response to query)
5/27 10:01:05 Got QUERY_STARTD_ADS
5/27 10:01:05 (Sending 2 ads in response to query)
5/27 10:01:06 Got QUERY_STARTD_ADS
5/27 10:01:06 (Sending 2 ads in response to query)
5/27 10:01:16 WARNING:  No master ad for <
CLASS11362DSK09.soroka.clalit.org.il >
5/27 10:01:16 ScheddAd     : Inserting ** "<
CLASS11362DSK09.soroka.clalit.org.il , 172.24.34.114 >"
5/27 10:01:16 stats: Inserting new hashent for
'Schedd':'CLASS11362DSK09.soroka.clalit.org.il':'172.24.34.114'
5/27 10:01:17 DC_AUTHENTICATE: attempt to open invalid session
somaster:22597:1243407376:6, failing.
5/27 10:01:17 DC_AUTHENTICATE: attempt to open invalid session
somaster:22597:1243407376:7, failing.
5/27 10:01:30 WARNING:  No master ad for <
CLASS11364DSK11.soroka.clalit.org.il >
5/27 10:01:30 ScheddAd     : Inserting ** "<
CLASS11364DSK11.soroka.clalit.org.il , 172.24.35.109 >"
5/27 10:01:30 stats: Inserting new hashent for
'Schedd':'CLASS11364DSK11.soroka.clalit.org.il':'172.24.35.109'
5/27 10:01:42 DC_AUTHENTICATE: attempt to open invalid session
somaster:22597:1243407402:8, failing.
5/27 10:01:53 DC_AUTHENTICATE: attempt to open invalid session
somaster:22597:1243407413:10, failing.
5/27 10:02:12 DC_AUTHENTICATE: attempt to open invalid session
somaster:22597:1243407432:11, failing.
5/27 10:02:17 WARNING:  No master ad for <
CLASS11357DSK04.soroka.clalit.org.il >
5/27 10:02:17 ScheddAd     : Inserting ** "<
CLASS11357DSK04.soroka.clalit.org.il , 172.24.35.104 >"
5/27 10:02:17 stats: Inserting new hashent for
'Schedd':'CLASS11357DSK04.soroka.clalit.org.il':'172.24.35.104'
5/27 10:02:45 StartdAd     : Inserting ** "<
CLASS11359DSK06.soroka.clalit.org.il , 172.24.35.105 >"
5/27 10:02:45 stats: Inserting new hashent for
'Start':'CLASS11359DSK06.soroka.clalit.org.il':'172.24.35.105'
5/27 10:02:45 StartdPvtAd  : Inserting ** "<
CLASS11359DSK06.soroka.clalit.org.il , 172.24.35.105 >"
5/27 10:02:45 stats: Inserting new hashent for
'StartdPvt':'CLASS11359DSK06.soroka.clalit.org.il':'172.24.35.105'
5/27 10:02:56 WARNING:  No master ad for < Class0955desk7.soroka.clalit.org.il >
5/27 10:02:56 StartdAd     : Inserting ** "<
Class0955desk7.soroka.clalit.org.il , 172.24.35.98 >"
5/27 10:02:56 stats: Inserting new hashent for
'Start':'Class0955desk7.soroka.clalit.org.il':'172.24.35.98'
5/27 10:02:56 StartdPvtAd  : Inserting ** "<
Class0955desk7.soroka.clalit.org.il , 172.24.35.98 >"
5/27 10:02:56 stats: Inserting new hashent for
'StartdPvt':'Class0955desk7.soroka.clalit.org.il':'172.24.35.98'
5/27 10:02:56 MasterAd     : Inserting ** "<
michs13577con3.soroka.clalit.org.il >"
5/27 10:02:56 stats: Inserting new hashent for
'Master':'michs13577con3.soroka.clalit.org.il':'172.24.1.70'
5/27 10:03:10 Accumulating data: Time=1243407790
5/27 10:03:14 (Sending 18 ads in response to query)
5/27 10:03:14 Got QUERY_STARTD_PVT_ADS
5/27 10:03:14 (Sending 4 ads in response to query)
5/27 10:03:14 NegotiatorAd  : Inserting ** "< somaster >"
5/27 10:03:27 WARNING:  No master ad for <
CLASS11360DSK13.soroka.clalit.org.il >
5/27 10:03:27 StartdAd     : Inserting ** "<
CLASS11360DSK13.soroka.clalit.org.il , 172.24.35.97 >"
5/27 10:03:27 stats: Inserting new hashent for
'Start':'CLASS11360DSK13.soroka.clalit.org.il':'172.24.35.97'
5/27 10:03:27 StartdPvtAd  : Inserting ** "<
CLASS11360DSK13.soroka.clalit.org.il , 172.24.35.97 >"
5/27 10:03:27 stats: Inserting new hashent for
'StartdPvt':'CLASS11360DSK13.soroka.clalit.org.il':'172.24.35.97'
5/27 10:03:32 ** Master < CLASS11361DSK08.soroka.clalit.org.il >
rejuvenated from recently down
5/27 10:03:32 stats: Inserting new hashent for
'Master':'CLASS11361DSK08.soroka.clalit.org.il':'172.24.35.101'
5/27 10:03:41 StartdAd     : Inserting ** "<
CLASS11354DSK01.soroka.clalit.org.il , 172.24.34.113 >"
5/27 10:03:41 stats: Inserting new hashent for
'Start':'CLASS11354DSK01.soroka.clalit.org.il':'172.24.34.113'
5/27 10:03:41 StartdPvtAd  : Inserting ** "<
CLASS11354DSK01.soroka.clalit.org.il , 172.24.34.113 >"
5/27 10:03:41 stats: Inserting new hashent for
'StartdPvt':'CLASS11354DSK01.soroka.clalit.org.il':'172.24.34.113'
5/27 10:04:03 ** Master < CLASS11360DSK13.soroka.clalit.org.il >
rejuvenated from recently down
5/27 10:04:03 stats: Inserting new hashent for
'Master':'CLASS11360DSK13.soroka.clalit.org.il':'172.24.35.97'
5/27 10:04:10 Accumulating data: Time=1243407850
5/27 10:04:10 StartdAd     : Inserting ** "<
CLASS11350DSK12.soroka.clalit.org.il , 172.24.35.102 >"
5/27 10:04:10 stats: Inserting new hashent for
'Start':'CLASS11350DSK12.soroka.clalit.org.il':'172.24.35.102'
5/27 10:04:10 StartdPvtAd  : Inserting ** "<
CLASS11350DSK12.soroka.clalit.org.il , 172.24.35.102 >"
5/27 10:04:10 stats: Inserting new hashent for
'StartdPvt':'CLASS11350DSK12.soroka.clalit.org.il':'172.24.35.102'
5/27 10:04:15 ScheddAd     : Inserting ** "<
CLASS11360DSK13.soroka.clalit.org.il , 172.24.35.97 >"
5/27 10:04:15 stats: Inserting new hashent for
'Schedd':'CLASS11360DSK13.soroka.clalit.org.il':'172.24.35.97'
5/27 10:04:24 ** Master < CLASS11350DSK12.soroka.clalit.org.il >
rejuvenated from recently down
5/27 10:04:24 stats: Inserting new hashent for
'Master':'CLASS11350DSK12.soroka.clalit.org.il':'172.24.35.102'
5/27 10:04:29 WARNING:  No master ad for <
CLASS11358DSK05.soroka.clalit.org.il >
5/27 10:04:29 StartdAd     : Inserting ** "<
CLASS11358DSK05.soroka.clalit.org.il , 172.24.34.89 >"
5/27 10:04:29 stats: Inserting new hashent for
'Start':'CLASS11358DSK05.soroka.clalit.org.il':'172.24.34.89'
5/27 10:04:29 StartdPvtAd  : Inserting ** "<
CLASS11358DSK05.soroka.clalit.org.il , 172.24.34.89 >"
5/27 10:04:29 stats: Inserting new hashent for
'StartdPvt':'CLASS11358DSK05.soroka.clalit.org.il':'172.24.34.89'
5/27 10:04:29 ** Master < CLASS11354DSK01.soroka.clalit.org.il >
rejuvenated from recently down
5/27 10:04:29 stats: Inserting new hashent for
'Master':'CLASS11354DSK01.soroka.clalit.org.il':'172.24.34.113'
5/27 10:04:33 WARNING:  No master ad for <
CLASS11363DSK10.soroka.clalit.org.il >
5/27 10:04:33 StartdAd     : Inserting ** "<
CLASS11363DSK10.soroka.clalit.org.il , 172.24.35.96 >"
5/27 10:04:33 stats: Inserting new hashent for
'Start':'CLASS11363DSK10.soroka.clalit.org.il':'172.24.35.96'
5/27 10:04:33 StartdPvtAd  : Inserting ** "<
CLASS11363DSK10.soroka.clalit.org.il , 172.24.35.96 >"
5/27 10:04:33 stats: Inserting new hashent for
'StartdPvt':'CLASS11363DSK10.soroka.clalit.org.il':'172.24.35.96'
5/27 10:04:43 WARNING:  No master ad for <
CLASS11356DSK03.soroka.clalit.org.il >
5/27 10:04:43 StartdAd     : Inserting ** "<
CLASS11356DSK03.soroka.clalit.org.il , 172.24.35.100 >"
5/27 10:04:43 stats: Inserting new hashent for
'Start':'CLASS11356DSK03.soroka.clalit.org.il':'172.24.35.100'
5/27 10:04:43 StartdPvtAd  : Inserting ** "<
CLASS11356DSK03.soroka.clalit.org.il , 172.24.35.100 >"
5/27 10:04:43 stats: Inserting new hashent for
'StartdPvt':'CLASS11356DSK03.soroka.clalit.org.il':'172.24.35.100'
5/27 10:04:45 WARNING:  No master ad for < michs13611con2.soroka.clalit.org.il >
5/27 10:04:45 ScheddAd     : Inserting ** "<
michs13611con2.soroka.clalit.org.il , 172.24.1.64 >"
5/27 10:04:45 stats: Inserting new hashent for
'Schedd':'michs13611con2.soroka.clalit.org.il':'172.24.1.64'
5/27 10:04:46 (Sending 1 ads in response to query)
5/27 10:04:46 (Sending 30 ads in response to query)
5/27 10:04:46 Got QUERY_STARTD_PVT_ADS
5/27 10:04:46 (Sending 10 ads in response to query)
5/27 10:04:49 ScheddAd     : Inserting ** "<
michs13577con3.soroka.clalit.org.il , 172.24.1.70 >"
5/27 10:04:49 stats: Inserting new hashent for
'Schedd':'michs13577con3.soroka.clalit.org.il':'172.24.1.70'
5/27 10:04:49 WARNING:  No master ad for < michs13585con4.soroka.clalit.org.il >
5/27 10:04:49 ScheddAd     : Inserting ** "<
michs13585con4.soroka.clalit.org.il , 172.24.1.71 >"
5/27 10:04:49 stats: Inserting new hashent for
'Schedd':'michs13585con4.soroka.clalit.org.il':'172.24.1.71'
5/27 10:04:52 ** Master < michs13585con4.soroka.clalit.org.il >
rejuvenated from recently down
5/27 10:04:52 stats: Inserting new hashent for
'Master':'michs13585con4.soroka.clalit.org.il':'172.24.1.71'
5/27 10:05:10 Accumulating data: Time=1243407910
5/27 10:05:23 ** Master < Class0955desk7.soroka.clalit.org.il >
rejuvenated from recently down
5/27 10:05:23 stats: Inserting new hashent for
'Master':'Class0955desk7.soroka.clalit.org.il':'172.24.35.98'
5/27 10:05:28 ** Master < CLASS11358DSK05.soroka.clalit.org.il >
rejuvenated from recently down
5/27 10:05:28 stats: Inserting new hashent for
'Master':'CLASS11358DSK05.soroka.clalit.org.il':'172.24.34.89'
5/27 10:05:30 ScheddAd     : Inserting ** "<
CLASS11358DSK05.soroka.clalit.org.il , 172.24.34.89 >"
5/27 10:05:30 stats: Inserting new hashent for
'Schedd':'CLASS11358DSK05.soroka.clalit.org.il':'172.24.34.89'
5/27 10:05:30 StartdAd     : Inserting ** "<
michs13577con3.soroka.clalit.org.il , 172.24.1.70 >"
5/27 10:05:30 stats: Inserting new hashent for
'Start':'michs13577con3.soroka.clalit.org.il':'172.24.1.70'
5/27 10:05:30 StartdPvtAd  : Inserting ** "<
michs13577con3.soroka.clalit.org.il , 172.24.1.70 >"
5/27 10:05:30 stats: Inserting new hashent for
'StartdPvt':'michs13577con3.soroka.clalit.org.il':'172.24.1.70'
5/27 10:05:35 ScheddAd     : Inserting ** "<
Class0955desk7.soroka.clalit.org.il , 172.24.35.98 >"
5/27 10:05:35 stats: Inserting new hashent for
'Schedd':'Class0955desk7.soroka.clalit.org.il':'172.24.35.98'
5/27 10:05:51 StartdAd     : Inserting ** "<
CLASS11362DSK09.soroka.clalit.org.il , 172.24.34.114 >"
5/27 10:05:51 stats: Inserting new hashent for
'Start':'CLASS11362DSK09.soroka.clalit.org.il':'172.24.34.114'
5/27 10:05:51 StartdPvtAd  : Inserting ** "<
CLASS11362DSK09.soroka.clalit.org.il , 172.24.34.114 >"
5/27 10:05:51 stats: Inserting new hashent for
'StartdPvt':'CLASS11362DSK09.soroka.clalit.org.il':'172.24.34.114'
5/27 10:05:52 ** Master < CLASS11363DSK10.soroka.clalit.org.il >
rejuvenated from recently down
5/27 10:05:52 stats: Inserting new hashent for
'Master':'CLASS11363DSK10.soroka.clalit.org.il':'172.24.35.96'
5/27 10:05:54 ** Master < CLASS11356DSK03.soroka.clalit.org.il >
rejuvenated from recently down
5/27 10:05:54 stats: Inserting new hashent for
'Master':'CLASS11356DSK03.soroka.clalit.org.il':'172.24.35.100'
5/27 10:05:59 ScheddAd     : Inserting ** "<
CLASS11363DSK10.soroka.clalit.org.il , 172.24.35.96 >"
5/27 10:05:59 stats: Inserting new hashent for
'Schedd':'CLASS11363DSK10.soroka.clalit.org.il':'172.24.35.96'
5/27 10:06:01 ScheddAd     : Inserting ** "<
CLASS11356DSK03.soroka.clalit.org.il , 172.24.35.100 >"
5/27 10:06:01 stats: Inserting new hashent for
'Schedd':'CLASS11356DSK03.soroka.clalit.org.il':'172.24.35.100'
5/27 10:06:10 Accumulating data: Time=1243407970
5/27 10:06:10 Could not open data file
/export/condor-history/viewhist0.0.new for appending!!! errno=13
5/27 10:06:10 ERROR "Could not open data file appending!!!" at line
737 in file view_server.C
5/27 10:06:20 ******************************************************
5/27 10:06:20 ** condor_collector (CONDOR_COLLECTOR) STARTING UP
5/27 10:06:20 ** /opt/condor-7.0.3/sbin/condor_collector
5/27 10:06:20 ** $CondorVersion: 7.0.3 Jun 20 2008 BuildID: 91405 $
5/27 10:06:20 ** $CondorPlatform: I386-LINUX_RHEL5 $
5/27 10:06:20 ** PID = 23034
5/27 10:06:20 ** Log last touched 5/27 10:06:10

thank you
Levi