[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Docker universe and file transfer plugins



On 6/7/2023 6:22 AM, Jan Behrend wrote:
Hi everyone,

To transfer data these nodes have an additional 10GbE connection to a node which
in turn has access to the common file system.  

Hi Jan,

What is the nature of the access between these nodes and the common file system?  Do the nodes mount the file system or ?

Unfortunately our processing is heavily based on Docker, from which these
plugins are explicitly excluded.

Not sure I understand the above....  Files transferred by HTCondor to the Execution Point (compute node) are deposited in the "job scratch directory"... For Docker Universe jobs, this scratch directory is volume mounted into the Docker container, so Docker universe jobs access these files same as non-Docker jobs.


Best regards,
Todd


-- 
Todd Tannenbaum <tannenba@xxxxxxxxxxx>  University of Wisconsin-Madison
Center for High Throughput Computing    Department of Computer Sciences
Calendar: https://tinyurl.com/yd55mtgd  1210 W. Dayton St. Rm #4257
Phone: (608) 263-7132                   Madison, WI 53706-1685