[Condor-users] limit on input file transfers ????

["Dr Ian C. Smith" <i.c.smith@xxxxxxxxxxxxxxx>]

Very quick question:

Is there a Condor-imposed limit on the total size of
input files that can be transfered to an execute host or
a limit on the total time it takes to transfer them.

I'm looking at using Condor for BLAST searches and seeing
whether it is feasible to copy the databases over to
the execute hosts. I keep getting a series of error messages
like this in the job log file:


> 007 (23881.000.000) 03/30 13:57:07 Shadow exception!
>         Can no longer talk to condor_starter on execute machine
> (138.253.102.153)         0  -  Run Bytes Sent By Job
>         -671628160  -  Run Bytes Received By Job
> ...
> 007 (23881.000.000) 03/30 14:06:50 Shadow exception!
>         Can no longer talk to condor_starter on execute machine
> (138.253.102.153)         0  -  Run Bytes Sent By Job
>         -671628160  -  Run Bytes Received By Job

The entire database is ~ 3.5 GB but the largest file in only ~ 500 MB
and there is enough free disk space on the execution host. The negative
value for the bytes transferred suggests a 32 bit addressing limitation
to me.

cheers,

-ian.


-----------------------------------
Dr Ian C. Smith,
e-Science team,
University of Liverpool
Computing Services Department