Re: [Condor-users] Monitoring remote job progress

[Javier Forment Millet <jforment@xxxxxxxxxxxx>]

Addendum: By 'incomplete file' I mean that the output file lacks of the last
portion of the output. It seems like Condor fails to back-transfer the last
chunk of output...



Quoting Javier Forment Millet <jforment@xxxxxxxxxxxx>:

> This works fine, but not completely: when I do that, I effectively can
> monitor
> the progress of the process because the file indicated in the 'output'
> parameter at the process configuration file is created and filled at the
> submit
> node and not in the execution node. But there is some strange behaviour
> because
> it consistently ends incomplete: the condor process apparently ends fine
> (nothing at condor_q, 'Normal termination (return value 0)'at log file,...),
> but the output file is incomplete, and the temporary directory at execution
> node (inside /home/condor/execute/) is not removed.
>
> Any idea?
>
>
>
> Quoting Ben Burnett <burnett@xxxxxxxxxxx>:
>
> > Hi Javier:
> >
> > If you want to monitor the jobs from the submit machine, then you could try
> > setting stream_output/_error to true.  This would allow you to check the
> > progress on the execute side by looking at the local output/error files.
> >
> > Regards,
> > -B
> >
> > > -----Original Message-----
> > > From: condor-users-bounces@xxxxxxxxxxx [mailto:condor-users-
> > > bounces@xxxxxxxxxxx] On Behalf Of Javier Forment Millet
> > > Sent: Tuesday, June 17, 2008 4:25 AM
> > > To: Condor-Users Mail List
> > > Subject: [Condor-users] Monitoring remote job progress
> > >
> > > Hi, all...
> > >
> > > I'm running long-time processes in a Condor cluster. These processes
> > > write
> > > output files which can be inspected to estimate the final total
> > > execution time
> > > of the process.
> > >
> > > Is there any way to see these files before the end of the process
> > > without
> > > logging to the execution nodes? (something like a Condor variable in
> > > the
> > > process configuration file requesting the transfer of yet incomplete
> > > output
> > > files).
> > >
> > > Thanks in advance,
> > >
> > > Javier.
> > >
> > > --
> > > Javier Forment Millet
> > > Instituto de Biología Celular y Molecular de Plantas (IBMCP) CSIC-UPV
> > >  Ciudad Politécnica de la Innovación (CPI) Edificio 8 E, Escalera 7
> > > Puerta E
> > >  Calle Ing. Fausto Elio s/n. 46022 Valencia, Spain
> > > Tlf.:+34-96-3877858
> > > FAX: +34-96-3877859
> > > jforment@xxxxxxxxxxxx
> > >
> > > _______________________________________________
> > > Condor-users mailing list
> > > To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with
> > > a
> > > subject: Unsubscribe
> > > You can also unsubscribe by visiting
> > > https://lists.cs.wisc.edu/mailman/listinfo/condor-users
> > >
> > > The archives can be found at:
> > > https://lists.cs.wisc.edu/archive/condor-users/
> >
> > _______________________________________________
> > Condor-users mailing list
> > To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> > subject: Unsubscribe
> > You can also unsubscribe by visiting
> > https://lists.cs.wisc.edu/mailman/listinfo/condor-users
> >
> > The archives can be found at:
> > https://lists.cs.wisc.edu/archive/condor-users/
> >
>
>
> --
> Javier Forment Millet
> Instituto de Biología Celular y Molecular de Plantas (IBMCP) CSIC-UPV
>  Ciudad Politécnica de la Innovación (CPI) Edificio 8 E, Escalera 7 Puerta E
>  Calle Ing. Fausto Elio s/n. 46022 Valencia, Spain
> Tlf.:+34-96-3877858
> FAX: +34-96-3877859
> jforment@xxxxxxxxxxxx
>
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/condor-users/
>


-- 
Javier Forment Millet
Instituto de Biología Celular y Molecular de Plantas (IBMCP) CSIC-UPV
 Ciudad Politécnica de la Innovación (CPI) Edificio 8 E, Escalera 7 Puerta E
 Calle Ing. Fausto Elio s/n. 46022 Valencia, Spain
Tlf.:+34-96-3877858
FAX: +34-96-3877859
jforment@xxxxxxxxxxxx