[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Central Manager Disk Space [SEC=UNCLASSIFIED]



Thanks John,

 

Currently in our small-scale setup I have the central manager as the intermediate submit node.   So I guess it is spooling the job files on completion, if the original submitter is disconnected.  Is this the case on submission as well if all execute nodes are occupied?

 

What is required to configure the central manager as separate from a intermediate submit node?  And will this occupy processing resources of that node if it is dealing with intermediate job submission in a HTCondor-C environment?

 

Cheers

 

Troy

 

On 15 February 2014 2:45 AM John (TJ) Knoeller wrote

 

Job data and executable are transferred directly from the submit node to the execute node.  The central manager will not need space to store this data.

For a condor-c configuration,  job data and executable will be transferred from submit node to submit node,
and job results will be held in the spool directory of the intermediate submit until the originating submit can fetch them.  But even in this configuration the central manager still doesn't ever see the job data or executable.

-tj

On 2/13/2014 6:02 PM, Troy Robertson wrote:

Hi all,

 

I am looking at setting up our central manager on a CentOS virtual machine but need to make a decision about disk size for the image. 

Do all queued job executables and input files get held at the central manager prior to matching, or are they transferred directly from the submitter to executor once matched? 

Does the same happen for output files, particularly in the case of a Condor-C configuration?

I guess I have to then look at how many jobs could potentially be queued at any one time and the general size of the input/output files.

 

Does anyone have prior experiences that could help feed into my decision.

 

Troy

 

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
 
The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

 

___________________________________________________________________________

    Australian Antarctic Division - Commonwealth of Australia
IMPORTANT: This transmission is intended for the addressee only. If you are not the
intended recipient, you are notified that use or dissemination of this communication is
strictly prohibited by Commonwealth law. If you have received this transmission in error,
please notify the sender immediately by e-mail or by telephoning +61 3 6232 3209 and
DELETE the message.
        Visit our web site at http://www.antarctica.gov.au/
___________________________________________________________________________