Re: [HTCondor-users] HTCondor "executable" DOS batch file - while jobs in the queue can the batch file be changed?

[Michael Pelletier <Michael.V.Pelletier@xxxxxxxxxxxx>]

The executable and input transfers are grabbed at job startup. This has posed a bit of a problem in some of our cases with JAR files and input data when the users are actively building multiple scenarios with hours worth of Monte Carlos each.

I got around it by using an "include : command" directive in the submit description to create a tarball for the submission which is what's listed in the "transfer_input_files" line. Then, using a scheduler universe job at the end of the submit description, I submit a script which does a condor_wait on the log file using the previous cluster ID number [ ARG = $(Cluster) - 1 and $INT(ARG) ] to wait until all of the jobs in the main cluster are finished, and then removes the input data tarball.

This insures that all of the jobs in the cluster get the same inputs, even if the user subsequently makes tweaks in the code and input data.

	-Michael Pelletier.

-----Original Message-----
From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx] On Behalf Of Greg.Hitchen@xxxxxxxx
Sent: Tuesday, April 3, 2018 2:07 AM
To: htcondor-users@xxxxxxxxxxx
Subject: [External] [HTCondor-users] HTCondor "executable" DOS batch file - while jobs in the queue can the batch file be changed?

Hi All

As the title suggests, when the executable is a DOS batch file can that batch file be modified and the mods take effect when currently idle jobs are started.

I would obviously expect that those already running will be using the original batch file.

I guess this is asking a more general question of "when" does HTCondor "grab" the "executable"?
At submit time? Or at job start time?

Thanks.

Cheers

Greg

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/