[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[HTCondor-users] Question about the same transfer_input_files , Thank you.



Hi all, I want to run the linux shell command on htcondor:
/usr/bin/ffmpeg   -i    input_file  -y out_put.file
But  the real command is  :
/usr/bin/ffmpeg   -i   abc.mp4 -y abc_1.png
/usr/bin/ffmpeg  -i   abc.mp4  -y  abc_2.png
I write the condor_submit file as follows :

executable=/usr/bin/ffmpeg
universe=vanilla
transfer_input_files=/home/condor/abc.mp4
transfer_output_files=abc_1.png
arguments=" -i abc.mp4 -ss 0 -vframes 1 -y abc_1.png"
Log=/data/condor_Log/log/abc.log
Error=/data/condor_Log/err/abc.error
should_transfer_files=YES
when_to_transfer_output=ON_EXIT
queue
executable=/usr/bin/ffmpeg
universe=vanilla
transfer_input_files=/home/condor/abc.mp4
transfer_output_files=abc_1002.png
arguments=" -i abc.mp4 -ss 40.04 -vframes 1 -y abc_1002.png"
Log=/data/condor_Log/log/abc.log
Error=/data/condor_Log/err/abc.error
should_transfer_files=YES
when_to_transfer_output=ON_EXIT
queue

As shown above, both of them have the same input file.
 In fact I want to let only one machine to run both of them. Or else, It will take a long time to transfer the input file between several different computers.
Can you tell me how to make the commands with same transfer_input_files  run on the same slot or computer and not necessary to transfer the file each time?
For example:

/usr/bin/ffmpeg   -i   abc.mp4 -y abc_1.png
/usr/bin/ffmpeg  -i   abc.mp4  -y  abc_2.png
/usr/bin/ffmpeg   -i   def.mp4 -y def_1.png
/usr/bin/ffmpeg  -i   def.mp4  -y  def_2.png

I want  the first one and the second one run on the same slot or computer and transfer the input file (abc.mp4) only one time.
Thank you very much.
Best regards .


 

lijian@xxxxxxx