[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] [ExternalEmail] Windows - Condor 8.4.1 - queue command in submit file



OK, I've also tried this on a Ubuntu 14 machine with condor 8.4.1 and get the same results
i.e. Queue from <script> |
Execute <script> and treat output lines as items
doesn't work.

I can do the following (making sure there is no queue command in the submit file) on
both windows:

dir/b *.dat | condor_submit test.sub -queue fname from -

and linux:

ls -1 *.dat | condor_submit test.sub -queue fname from -

and for only linux:

condor_submit test.sub -queue fname in *.dat

this does not work for windows (file globbing doesn't work I assume).

Has anyone tried the queue command with a script?

Thanks

Cheers

Greg

-----Original Message-----
From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx] On Behalf Of Greg.Hitchen@xxxxxxxx
Sent: Wednesday, 11 November 2015 4:20 PM
To: htcondor-users@xxxxxxxxxxx
Subject: [ExternalEmail] [HTCondor-users] Windows - Condor 8.4.1 - queue command in submit file

Hi All

I've been fiddling with condor 8.4.1 on a windows submit machine and testing the
new features of the "queue" command.

Simple submit file:

universe = vanilla
executable = test.bat
output = test_$(Cluster)_$(Process).out
error = test_$(Cluster)_$(Process).err
log = test_$(Cluster)_$(Process).log
requirements = (Arch == "INTEL" || Arch == "X86_64")
+Shortjob = True
rank = ConsoleIdle
arguments = $(ItemIndex)
transfer_input_files = $(fname), dummy.dll
#queue fname in input_0.dat input_1.dat input_2.dat input_3.dat input_4.dat input_5.dat input_6.dat input_7.dat input_8.dat input_9.dat 
#queue fname matching files *.dat
#queue fname from files.txt
queue fname from files.bat |


All 3 commented out "queue" statements work fine (and identically as expected),
however the last one (attempting to use a script) does not.

The files.bat script is just the command:
dir /b *.dat

When running condor_submit I get:

WARNING: Empty value(s) for fname at ItemIndex=0!.
ERROR: Can't open "C:\Data\condor_stuff\examples\condor_test>dir /b *.dat"  with flags 00 (Invalid argument)

It appears as though it is not recognizing it as a script and is just trying
to look for a list of items (files) in files.bat?

Further testing with the text file of filenames shows that:
queue fname from files.txt |
gives an error:
ERROR: on Line 21 of submit file: not a valid command
ERROR: Failed to parse command file (line 21).

So it appears as though having the | symbol means something at least.

I'm probably doing something wrong. Can anyone enlighten me? Maybe this isn't implemented
in windows yet?

Thanks

Cheers

Greg


_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/