I just hit upon a snag for one of the programs we run. One method of using our program requires subdirectories (of input) to the PWD of it's execution. Since the standard file transfer mechanism in Condor for windows makes a flat directory, what can I do to preserve the structure? I've had ideas like using tar/zip/etc, but our resulting output may be several gigabytes, so this would be slow and may result with a file bigger than the file system could handle.
As a little background, we have 2 clusters, a development one and a production one. The development cluster is running the Bristol stuff so we map file shares (required due to a specific developer user requirement). For the production cluster I am trying to stay away from the added complexity and network overhead of the Bristol stuff. As such this issue is only relevant to our production cluster.
Thanks for any ideas.
CONFIDENTIAL AND PRIVILEGED INFORMATION NOTICE
This e-mail, and any attachments, may contain information that
is confidential, subject to copyright, or exempt from disclosure.
Any unauthorized review, disclosure, retransmission,
dissemination or other use of or reliance on this information
may be unlawful and is strictly prohibited.
AVIS D'INFORMATION CONFIDENTIELLE ET PRIVILÉGIÉE
Le présent courriel, et toute pièce jointe, peut contenir de
l'information qui est confidentielle, régie par les droits
d'auteur, ou interdite de divulgation. Tout examen,
divulgation, retransmission, diffusion ou autres utilisations
non autorisées de l'information ou dépendance non autorisée
envers celle-ci peut être illégale et est strictement interdite.