[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] as user set HOME/IWD/PWD to EP scratch rather than shared filesystem?




On 3/20/24 10:45 AM, Thomas Hartmann wrote:
Hi all,

is there a way for a user to rearrange a job's initial path son an Execution Point to point the relevant envvar paths to the job's scratch directory - when the EP has a shared filesystem with the Access Point?


Hi Thomas:

There's a couple of different options here -- if you have a shared filesystem between AP and EP, you can force file transfer on with

should_transfer_files = true


and then the job's pwd will be the scratch directory, etc.

Or, if you just want to set a bunch of environment variables to point into the scratch directory of a job, on relatively recent HTCondor's, you can put in your submit file

Environment = SOME_ENV_VAR=$$(CondorScratchDir)


and that will set SOME_ENV_VAR in the job to the value of the condor scratch directory.


-greg



I.e., in a submit file tell Condor as a user to have
Â_CONDOR_JOB_IWD
point to
 _CONDOR_SCRATCH_DIR

Or would something like that require an admin's job transform?

Cheers,
 Thomas

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/