Re: [HTCondor-users] Unexpected File Transfer Behavior Windows to Linux

["Deck, William" <William.Deck@xxxxxxx>]

Zach,

Your workaround worked great.  Thanks for the help and putting in the bug ticket.

-----Original Message-----
From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx] On Behalf Of Zach Miller
Sent: Wednesday, June 14, 2017 10:53 AM
To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Subject: Re: [HTCondor-users] Unexpected File Transfer Behavior Windows to Linux

Hi Will,

This sounds like a bug related to translating the directory delimiter, which is '\' on Windows and '/' on Linux.  I've made a ticket and it should be an easy fix:

  https://htcondor-wiki.cs.wisc.edu/index.cgi/tktview?tn=6302



There may be a possible workaround, though very ugly, using transfer_output_remaps.  I haven't tested it at all, and using a backslash within there may be tricky due to the quoting rules.  If I had to guess, you could try this in your submit file:

  transfer_output_remaps = "results\\output.h5=results/output.h5"


Cheers,
-zach


> -----Original Message-----
> From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx] On
> Behalf Of Deck, William
> Sent: Wednesday, June 14, 2017 8:41 AM
> To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
> Subject: [HTCondor-users] Unexpected File Transfer Behavior Windows to
> Linux
>
> Hello All,
>
>
>
> I am currently running into an issue trying to transfer output from a
> Windows (2012R2) Exec back to a Linux (SLES11SP3) schedd.  The job
> creates a directory named results in the condor execute directory and
> writes output there.  Then based on the submit file Condor tries to
> copy the results directory back to the schedd.  However it looks like
> it gets confused about the file name and ends up creating a file
> called results\output.h5 on the schedd instead of putting output.h5
> into the results directory.  Am I doing something incorrectly or is
> there some undefined behavior pulling files back from a Windows exec?
> Thanks in advance for any help and please let me know if you need any more information.
>
>
>
> Relevant submit information:
>
> transfer_output_files = results
>
> should_transfer_files = yes
>
> WhenToTransferOutput = ON_EXIT_OR_EVICT
>
>
>
> Job directory (After job runs):
>
> job.submit
>
> job.bat
>
> log/
>
> postscript.sh
>
> results/
>
> results\output.h5  (output file)
>
> spread19_20170404_001.yaml
>
>
>
> --
>
> Will Deck
>
>
>
>
> ________________________________
>
>
> IMPORTANT: The information contained in this email and/or its
> attachments is confidential. If you are not the intended recipient,
> please notify the sender immediately by reply and immediately delete
> this message and all its attachments. Any review, use, reproduction,
> disclosure or dissemination of this message or any attachment by an
> unintended recipient is strictly prohibited. Neither this message nor
> any attachment is intended as or should be construed as an offer,
> solicitation or recommendation to buy or sell any security or other
> financial instrument. Neither the sender, his or her employer nor any
> of their respective affiliates makes any warranties as to the
> completeness or accuracy of any of the information contained herein or that this message or any of its attachments is free of viruses.

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

________________________________

IMPORTANT: The information contained in this email and/or its attachments is confidential. If you are not the intended recipient, please notify the sender immediately by reply and immediately delete this message and all its attachments. Any review, use, reproduction, disclosure or dissemination of this message or any attachment by an unintended recipient is strictly prohibited. Neither this message nor any attachment is intended as or should be construed as an offer, solicitation or recommendation to buy or sell any security or other financial instrument. Neither the sender, his or her employer nor any of their respective affiliates makes any warranties as to the completeness or accuracy of any of the information contained herein or that this message or any of its attachments is free of viruses.