Mailing List Archives

Public Access

 		[Computer Systems Lab]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] Rendering

Hi again Nicolas,
 The Arguments directive in the submit File is to pass your
Executable's command line arguments to the Condor's Job.
Taking some examples from this site:
 http://www.catswhocode.com/blog/19-ffmpeg-commands-for-all-needs

Turn a video to X images
 ffmpeg -i video.mpg image%d.jpg

To run that command in Condor we must set:
 Executable=/usr/bin/ffmpeg
 Arguments="-i video.mpg image%d.jpg"

Extracting sound from a video, and save it as Mp3
 ffmpeg -i source_video.avi -vn -ar 44100 -ac 2 -ab 192 -f mp3 sound.mp3

To run that command in Condor we must set:
 Executable=/usr/bin/ffmpeg
 Arguments="-i source_video.avi -vn -ar 44100 -ac 2 -ab 192 -f mp3 sound.mp3"

If you read again my firsts answers I asked you about How do you run
ffmpeg actually (In one PC without Condor), so we can figure which
arguments, inputs, outputs and command you will need to use and run.

Good night.


On 3/30/12, Nicolas Nassif <nicolas-nassif@xxxxxxxx> wrote:
>
> Hi,My submit.condor
> is:Universe=VanillaShould_Transfer_Files=YesWhen_To_Transfer_Output=ON_EXIT_OR_EVICTTransfer_Executable=falseExecutable=/usr/bin/ffmpegLog=Global_Job_Log.txt
> Arguments="-arg1
> -arg2"Input=vd.aviOutput=File_To_Save_Output$(process)Error=Error.$(PROCESS).txtQueue
> 10
> THE PROBLEM IS THAT WHEN I ENTER ERROR.0.txt OR WHAT EVER OTHER ERROR,THEY
> SHOW ME UNRECOGNIZED OPTION 'arg1'I SHOW IT IN THE PAST MAILS PLZ CHECK
> ITTHANK YOU
> Date: Fri, 30 Mar 2012 10:33:17 -0500
> Subject: Re: [Condor-users] Rendering
> From: edalzap@xxxxxxxxx
> To: condor-users@xxxxxxxxxxx
> CC: nicolas-nassif@xxxxxxxx
>
> Hi,
>  Nicolas, can you show us the submit file you created for this task?
> bye.
>
> On Thu, Mar 29, 2012 at 5:18 AM, Nicolas Nassif <nicolas-nassif@xxxxxxxx>
> wrote:
>
>
>
>
>
> thank you thomas it's working finally.
> -- Submitter: node1.jessnix.com : <192.168.1.75:40627> : node1.jessnix.com
>
>  ID      OWNER            SUBMITTED     RUN_TIME HOST(S)
>   22.0   condor1         3/30 03:10   0+00:00:17 node.jessnix.com
>   22.9   condor1         3/30 03:10   0+00:00:01 node1.jessnix.com
>
> But when i open an error.1.txt per exemple or error.2.txt it show me:
> FFmpeg version 0.6.5, Copyright (c) 2000-2010 the FFmpeg developers
>   built on Jan 29 2012 23:55:02 with gcc 4.1.2 20080704 (Red Hat 4.1.2-51)
>
>   configuration: --prefix=/usr --libdir=/usr/lib64 --shlibdir=/usr/lib64
> --mandir=/usr/share/man --incdir=/usr/include --disable-avisynth
> --extra-cflags='-O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions
> -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -fPIC'
> --enable-avfilter --enable-avfilter-lavf --enable-libdirac --enable-libfaac
> --enable-libfaad --enable-libfaadbin --enable-libgsm --enable-libmp3lame
> --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libx264
> --enable-gpl --enable-nonfree --enable-postproc --enable-pthreads
> --enable-shared --enable-swscale --enable-vdpau --enable-version3
> --enable-x11grab
>
>   libavutil     50.15. 1 / 50.15. 1
>   libavcodec    52.72. 2 / 52.72. 2
>   libavformat   52.64. 2 / 52.64. 2
>   libavdevice   52. 2. 0 / 52. 2. 0
>
>   libavfilter    1.19. 0 /  1.19. 0
>   libswscale     0.11. 0 /  0.11. 0
>   libpostproc   51. 2. 0 / 51. 2. 0
> Unrecognized option 'arg1'
>
>> From: Thomas.Luff@xxxxxxx
>
>> To: condor-users@xxxxxxxxxxx
>> Date: Thu, 29 Mar 2012 09:42:59 +0100
>> Subject: Re: [Condor-users] Rendering
>>
>
>> try running `condor_q -ana 34.0` and have a look at the output. it could
>> be that you need to provide an absolute path to ffmpeg.
>>
>> If you're stuck paste the output here, and also paste `condor_q -long
>> 34.0`.
>
>>
>> If you still can't figure out why check your Startd log files on the hosts
>> they landed on.
>>
>> Tom
>> ________________________________________
>> From: condor-users-bounces@xxxxxxxxxxx [condor-users-bounces@xxxxxxxxxxx]
>> On Behalf Of Nicolas Nassif [nicolas-nassif@xxxxxxxx]
>
>> Sent: 29 March 2012 09:36
>> To: condor-users@xxxxxxxxxxx
>> Subject: Re: [Condor-users] Rendering
>>
>> the job is running but:
>>
>
>> -- Submitter: node.jessnix.com : <192.168.1.74:36389> : node.jessnix.com
>
>>  ID      OWNER            SUBMITTED     RUN_TIME ST PRI SIZE CMD
>>   34.0   condor1         3/29 03:33   0+00:00:03 H  0   0.0  ffmpeg
>>   34.1   condor1         3/29 03:33   0+00:00:03 H  0   0.0  ffmpeg
>
>>   34.2   condor1         3/29 03:33   0+00:00:02 H  0   0.0  ffmpeg
>>   34.3   condor1         3/29 03:33   0+00:00:02 H  0   0.0  ffmpeg
>>   34.4   condor1         3/29 03:33   0+00:00:02 H  0   0.0  ffmpeg
>
>>   34.5   condor1         3/29 03:33   0+00:00:02 H  0   0.0  ffmpeg
>>   34.6   condor1         3/29 03:33   0+00:00:02 H  0   0.0  ffmpeg
>>   34.7   condor1         3/29 03:33   0+00:00:02 H  0   0.0  ffmpeg
>
>>   34.8   condor1         3/29 03:33   0+00:00:02 H  0   0.0  ffmpeg
>>   34.9   condor1         3/29 03:33   0+00:00:02 H  0   0.0  ffmpeg
>> 10 jobs; 0 idle, 0 running, 10 held
>>
>>
>> can we fix these 10 held? And run them?
>
>>
>> thank you all for replying
>>
>> > From: Thomas.Luff@xxxxxxx
>> > To: condor-users@xxxxxxxxxxx
>
>> > Date: Thu, 29 Mar 2012 09:15:46 +0100
>> > Subject: Re: [Condor-users] Rendering
>> >
>> > I'm clueless on rendering but using the below approach mentioned by
>> > Edier you could do something like follows
>
>> >
>> > split video.avi into x parts. each with the name video.1.avi,
>> > video.2.avi, video.n.avi or similar
>> >
>> > Then your condor submit file would like
>> >
>> > # ffmpeg Submit File
>
>> > Universe=Vanilla
>> > Should_Transfer_Files = Yes
>> > When_To_Transfer_Output = ON_EXIT_OR_EVICT
>> > Transfer_Executable=false
>> > Executable=ffmpeg
>> > Log=Global_Job_Log.txt
>
>> >
>> > Arguments= "-arg 1 -arg 2"
>> > Input = video.$(PROCESS).avi
>> > Error=Error.$(PROCESS).txt
>> > Queue 10
>> >
>> >
>> > The `Queue 10` will then submit 10 jobs, each with the same Cluster ID
>> > but a different Process ID, then `$(PROCESS)` will be expanded to the
>> > job's process id, and only fetch that video part.
>
>> >
>> > Obviously `Queue 10` can be substituted for however many video parts you
>> > may have.
>> >
>> > It may also be worth looking at
>> > http://www.cirquedigital.com/products/gdiqueue/ - A tool built on top of
>> > condor that claims "Distributed rendering made easy".
>
>> >
>> > Tom
>> > ________________________________________
>> > From: condor-users-bounces@xxxxxxxxxxx
>> > [condor-users-bounces@xxxxxxxxxxx] On Behalf Of Edier Zapata
>> > [edalzap@xxxxxxxxx]
>
>> > Sent: 28 March 2012 23:40
>> > To: Nicolas Nassif
>> > Cc: condor-users
>> > Subject: Re: [Condor-users] Rendering
>> >
>> > Assuming you have ffmpeg in all your nodes I think you could run
>> > something like this:
>
>> > #
>> > # ffmpeg Submit File
>> > #
>> > Universe=Vanilla
>> > should_transfer_files = Yes
>> > when_to_transfer_output = ON_EXIT_OR_EVICT
>> > transfer_executable=false
>
>> > Executable=ffmpeg
>> > Log=Global_Job_Log.txt
>> >
>> > Arguments= "Your arguments + Your Video File to 1st Run"
>> > Input = You_Video_File
>> > Output=File_To_Save_Output$(process) # Maybe you don't need this one.
>
>> > Error=Error$(process).txt
>> > queue
>> >
>> > Arguments= "Your arguments + Your Video File to 2nd Run"
>> > Input = You_Video_File
>> > Output=File_To_Save_Output$(process) # Maybe you don't need this one.
>
>> > Error=Error$(process).txt
>> > queue
>> > .
>> > .
>> > .
>> > # End of Submit File
>> > condor_submit submit.condor (I recommend make a folder and save the
>> > submit file, and other required file in it, and run condor_submit from
>> > there)
>
>> >
>> > Bye.
>> > On Wed, Mar 28, 2012 at 5:22 PM, Nicolas Nassif
>> > <nicolas-nassif@xxxxxxxx<mailto:nicolas-nassif@xxxxxxxx>> wrote:
>
>> >
>> > Am using ffmpeg in my centos,i need to run a job(that job is to submit a
>> > video on 2 machines running centos to see the time)
>> > If u have other programs that r similar to that job plz let me know And
>> > how it can be submitted
>
>> > Thank u
>> >
>> > On 29 Mar 2012, at 12:36 AM, "Edier Zapata"
>> > <edalzap@xxxxxxxxx<mailto:edalzap@xxxxxxxxx>> wrote:
>
>> >
>> > Hi Nicholas,
>> > 1. which program will you use to render the video? ffmpeg?
>> > 2. That program have Linux and Windows version?
>> > 3. Explicitly what do you mean by Render a video?
>
>> > Can you paste an example of the command you use to render it manually?
>> >
>> > Bye.
>> >
>> > On Wed, Mar 28, 2012 at 7:16 AM, Nicolas Nassif
>> > <nicolas-nassif@xxxxxxxx<mailto:nicolas-nassif@xxxxxxxx>> wrote:
>
>> > Hi,
>> > I have created my condor pool,that contains 6 cpu's running on centos
>> > and windows. My task is to render a video using condor_submit,but i
>> > don't know how,if can any one help me.
>> > N.B:i installed on centos(VM) ffmpeg and vlc.
>
>> > Thank you.
>> > Nicolas
>> > _______________________________________________
>> > Condor-users mailing list
>> > To unsubscribe, send a message to
>> > condor-users-request@xxxxxxxxxxx<mailto:condor-users-request@xxxxxxxxxxx>
>> > with a
>
>> > subject: Unsubscribe
>> > You can also unsubscribe by visiting
>> > https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
>> >
>> > The archives can be found at:
>> > https://lists.cs.wisc.edu/archive/condor-users/
>> >
>> >
>
>> >
>> > --
>> > Edier Alberto Zapata Hernández
>> > Ingeniero de Sistemas
>> > Universidad de Valle
>> >
>> >
>> >
>> > --
>> > Edier Alberto Zapata Hernández
>
>> > Ingeniero de Sistemas
>> > Universidad de Valle
>> >
>> > -- IMPORTANT NOTICE: The contents of this email and any attachments are
>> > confidential and may also be privileged. If you are not the intended
>> > recipient, please notify the sender immediately and do not disclose the
>> > contents to any other person, use it for any purpose, or store or copy
>> > the information in any medium. Thank you.
>
>> >
>> > _______________________________________________
>> > Condor-users mailing list
>> > To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with
>> > a
>
>> > subject: Unsubscribe
>> > You can also unsubscribe by visiting
>> > https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
>> >
>> > The archives can be found at:
>> > https://lists.cs.wisc.edu/archive/condor-users/
>>
>> -- IMPORTANT NOTICE: The contents of this email and any attachments are
>> confidential and may also be privileged. If you are not the intended
>> recipient, please notify the sender immediately and do not disclose the
>> contents to any other person, use it for any purpose, or store or copy the
>> information in any medium.  Thank you.
>
>>
>> _______________________________________________
>> Condor-users mailing list
>> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
>
>> subject: Unsubscribe
>> You can also unsubscribe by visiting
>> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
>>
>> The archives can be found at:
>> https://lists.cs.wisc.edu/archive/condor-users/
>  		 	   		
>
>
> _______________________________________________
>
> Condor-users mailing list
>
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
>
> subject: Unsubscribe
>
> You can also unsubscribe by visiting
>
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
>
>
> The archives can be found at:
>
> https://lists.cs.wisc.edu/archive/condor-users/
>
>
>
>
> --
> Edier Alberto Zapata Hernández
> Ingeniero de Sistemas
> Universidad de Valle
>  		 	   		


-- 
Edier Alberto Zapata Hernández
Ingeniero de Sistemas
Universidad de Valle