Mailing List Archives
Public Access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [HTCondor-users] Docker universe and file transfer plugins
- Date: Wed, 7 Jun 2023 15:17:28 -0500
- From: Todd Tannenbaum <tannenba@xxxxxxxxxxx>
- Subject: Re: [HTCondor-users] Docker universe and file transfer plugins
On 6/7/2023 6:22 AM, Jan Behrend wrote:
Hi everyone,
To transfer data these nodes have an additional 10GbE connection to a node which
in turn has access to the common file system.
Hi Jan,
What is the nature of the access between these nodes and the common
file system? Do the nodes mount the file system or ?
Unfortunately our processing is heavily based on Docker, from which these
plugins are explicitly excluded.
Not sure I understand the above.... Files transferred by HTCondor
to the Execution Point (compute node) are deposited in the "job
scratch directory"... For Docker Universe jobs, this scratch
directory is volume mounted into the Docker container, so Docker
universe jobs access these files same as non-Docker jobs.
Best regards,
Todd
--
Todd Tannenbaum <tannenba@xxxxxxxxxxx> University of Wisconsin-Madison
Center for High Throughput Computing Department of Computer Sciences
Calendar: https://tinyurl.com/yd55mtgd 1210 W. Dayton St. Rm #4257
Phone: (608) 263-7132 Madison, WI 53706-1685