[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Windows Samba and Condor



You can make a small DOS batch file to use as your Condor “executable”.

 

This batch file would copy across any files it needs, run the “real” executable, copy any results back,

and clean up after itself.

 

This then removes the burden of file transfers from the submit node to each of the individual execute nodes.

 

Cheers

 

Greg

 

From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx] On Behalf Of Dennis Zheleznyak
Sent: Monday, 6 January 2014 2:37 PM
To: HTCondor-Users Mail List
Subject: [HTCondor-users] Windows Samba and Condor

 

Hi everyone, 

 

I have a small cluster that consists of 5 Windows machines. 

 

The data it self sits on the domain controller of the environment, all the machines have a network mapped drive named L:\.

 

When submitting a lot of jobs, the submit machine copies the data from the network mapped drive to the "work" nodes - which is a huge drawback, the load on the network is huge and jobs can't start running since most of them are waiting to be copied. 

 

Is there any way to make the "work" nodes copy the data them selves instead of giving the submit to do that ? 

 

Thank you, 

Dennis.