[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Condor-users] Error in large file transfer : Condor or Winsock Bug ?

I'm trying to upload a very large input file, size in excess of 4Gb, using
Condor 6.6.11 on a cluster of XP machines.

The file continually fails with a 'failed to do upload message' (or similar)
reported in the job logs. 

Looking at the ShadowLog on the submit machine I see the following errors
reported :

9/1 13:40:38 Initializing a VANILLA shadow
9/1 13:40:38 (30740.0) (19384): Request to run on <xxx.xxx.xxx.176:4284> was
9/1 13:41:35 (30742.0) (13248): ReliSock: put_file: TransmitFile() failed,
9/1 13:41:35 (30742.0) (13248): ERROR "DoUpload: Failed to send file
E:\Temp_2\\XXX_depthprocessed_ts.txt , exiting at 1399
" at line 1398 in file ..\src\condor_c++_util\file_transfer.C

In the above it is the XXX_depthprocessed_ts.txt file that is > 4Gb.

Hence the problem seems to be in src\condor_c++_util\file_transfer.C. Is
this a Condor related fault or a fault in the underlying winsock file
transfer mechanism ? 

Any ideas much appreciated ....


Message protected by MailGuard: e-mail anti-virus, anti-spam and content filtering.