[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] dagman api



On Fri, 25 Oct 2013, Keith Brown wrote:

I suppose my intention was to build a Python API for it but it seems if I
call subprocess in python to condor_dag_man, I think that should be
sufficient. 

Below is an HTCondor submit file generated by condor_submit_dag. Note that if you spawn condor_dagman as a process, you'll have to pass most of the arguments below or condor_dagman won't run.

Also, you *must* have _CONDOR_DAGMAN_LOG set in the environment or condor_dagman won't run. I'm not sure if you absolutely need the other environment variables.

Kent

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

# Filename: job_dagman_basic.dag.condor.sub
# Generated by condor_submit_dag job_dagman_basic.dag universe = scheduler
executable	= /scratch/wenger/condor_build/git5/personal_condor/release_dir/bin/condor_dagman
getenv		= True
output		= job_dagman_basic.dag.lib.out
error		= job_dagman_basic.dag.lib.err
log		= job_dagman_basic.dag.dagman.log
remove_kill_sig	= SIGUSR1
+OtherJobRemoveRequirements	= "DAGManJobId == $(cluster)"
# Note: default on_exit_remove expression:
# ( ExitSignal =?= 11 || (ExitCode =!= UNDEFINED && ExitCode >=0 && ExitCode <= 2))
# attempts to ensure that DAGMan is automatically
# requeued by the schedd if it exits abnormally or
# is killed (e.g., during a reboot).
on_exit_remove	= ( ExitSignal =?= 11 || (ExitCode =!= UNDEFINED && ExitCode >=0 && ExitCode <= 2))
copy_to_spool	= False
arguments	= "-f -l . -Lockfile job_dagman_basic.dag.lock -AutoRescue 1 -DoRescueFrom 0 -Dag job_dagman_basic.dag -Suppress_notification -CsdVersion $CondorVersion:' '8.1.2' 'Oct' '07' '2013' 'BuildID:' 'UW_development' 'PRE-RELEASE-UWCS' '$ -Verbose -Force -Notification never -Dagman /scratch/wenger/condor_build/git5/personal_condor/release_dir/bin/condor_dagman"
environment	= _CONDOR_DAGMAN_LOG=job_dagman_basic.dag.dagman.out;_CONDOR_SCHEDD_ADDRESS_FILE=/scratch/wenger/condor_build/git5/personal_condor/spool/.schedd_address;_CONDOR_SCHEDD_DAEMON_AD_FILE=/scratch/wenger/condor_build/git5/personal_condor/spool/.schedd_classad;_CONDOR_MAX_DAGMAN_LOG=0
notification	= never
queue