[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] Condor file transfer with command line parameters [SEC=UNCLASSIFIED]



UNCLASSIFIED

Thanks Kevin.

I thought I may need to use a batch file wrapper as this has been
suggested in the archives. I wasn't aware of transfer_output_remaps.

What if each machine in my pool had a large amount of locally attached
storage. How would I go about storing all output files locally on each
execution machine (i.e. the machine in the pool where the job was run)
in a specific location? To be more specific, I have 100k runs, 5
execution machines in my pool, and what to store the output files
generated by each machine in D:\13_Jan_2011. I will then have a process
that will go through my 5 machines and collect all output files in
D:\13_Jan_2011 and place them in a single directory.

Peter

-----Original Message-----
From: condor-users-bounces@xxxxxxxxxxx
[mailto:condor-users-bounces@xxxxxxxxxxx] On Behalf Of
Kevin.Buckley@xxxxxxxxxxxxx
Sent: Thursday, 13 January 2011 12:01 PM
To: Condor-Users Mail List
Subject: Re: [Condor-users] Condor file transfer with command line
parameters [SEC=UNCLASSIFIED]

> I have a compiled MATLAB simulink model that is invoked by the command

> line in the following way:
>
> Model.exe -p C:\inputFile.mat -o C:\outputFile.mat, where input file 
> is on my local machine, and C:\ is where outputFile is placed when the

> job completes.
>
> How would I set up the ClassAd to execute the above command? If I use 
> Condor's in built mechanism to transfer the input file, how do I pass 
> it as a command line parameter to the executable, and how can I ensure

> that the output file is placed in the required location on my local 
> machine on completion?

The files you transfer over to the remote machine will all end up in the
same working directory so something like this in the job submission
script should work:


Executable = runmodel.bat
TransferInputFiles  = C:\Model.exe C:\inputFile.mat ShouldTransferFiles
= YES WhenToTransferOutput = ON_EXIT transfer_output_remaps =
"outputFile.mat = C:\outputFile.mat"

where you write a DOS batch file "runmodel.bat" to be

 Model.exe -p inputFile.mat -o outputFile.mat

as you'll be running in a directory specific to your job on the remote
execution node, so everything is relative.

-- 
Kevin M. Buckley                                  Room:  CO327
School of Engineering and                         Phone: +64 4 463 5971
 Computer Science
Victoria University of Wellington
New Zealand

_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with
a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/condor-users/

IMPORTANT: This email remains the property of the Department of Defence
and is subject to the jurisdiction of section 70 of the Crimes Act 1914.
If you have received this email in error, you are requested to contact
the sender and delete the email.