[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] limit on input file transfers ????



On Wed March 30 2005 7:27 am, Dr Ian C. Smith wrote:
> Very quick question:
>
> Is there a Condor-imposed limit on the total size of
> input files that can be transfered to an execute host or
> a limit on the total time it takes to transfer them.

> >         -671628160  -  Run Bytes Received By Job
>
> The entire database is ~ 3.5 GB but the largest file in only ~ 500 MB
> and there is enough free disk space on the execution host. The negative
> value for the bytes transferred suggests a 32 bit addressing limitation
> to me.

What version of Condor are you running?  Prior to Condor 6.7.2, Condor 
couldn't handle files larger than 2G, and it's possible that large 
collections of transfers could have caused problems, too (I don't remember 
all of the details).  These changes never appeared in the 6.6 series.

-Nick

-- 
           <<< Why, oh, why, didn't I take the blue pill? >>>
 /`-_    Nicholas R. LeRoy               The Condor Project
{     }/ http://www.cs.wisc.edu/~nleroy  http://www.cs.wisc.edu/condor
 \    /  nleroy@xxxxxxxxxxx              The University of Wisconsin
 |_*_|   608-265-5761                    Department of Computer Sciences