[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] How to transfer output file back into submission dir.



Hi Walid

No it doesnt accept without "" in transfer_output_remaps

Harinder

On Tue, Sep 16, 2014 at 1:33 AM, Walid Saad <walid.saadd@xxxxxxxxx> wrote:
Hi,
Try to use this sub file:
Jobs = 25
getenv     = false
executable   = SmallD3PD.sh
output     = output/SmallD3PD.out.$(Process)
error     Â= error/SmallD3PD.error.$(Process)
log      Â= log/SmallD3PD.log
arguments = $(Process) $(Jobs)
should_transfer_files = YES
when_to_transfer_output = ON_EXIT
transfer_input_files = dijet.tgz,/tmp/x509up_u55261,inputFileListLarge
transfer_output_remaps = /tmp/results.root=results$(Process).root
+ProjectName = "atlas-org-fresnostate"
queue $(Jobs)

Check SmallD3PD.log andÂSmallD3PD.error.$(Process) filesÂto see if all jobs are submitted and executed successfully.

Cordialement
Walid SAADÂ
LaTICE Laboratory University of Tunis,Â
ESSTT 5, Av. Taha Hussein, B.P. 56,Â
Bab Mnara, Tunis, Tunisia.Â
TÃl : (+216) 97 86 13 75Â

2014-09-16 2:28 GMT+02:00 Dr. Harinder Singh Bawa <harinder.singh.bawa@xxxxxxxxx>:

I am only getting Âresults.root (probably the last job output which overrides on other jobs).



tried 2 times
================
Jobs = 25
getenv     = false
executable   = SmallD3PD.sh
output     = output/SmallD3PD.out.$(Process)
error     Â= error/SmallD3PD.error.$(Process)
log      Â= log/SmallD3PD.log.$(Process)
arguments = $(Process) $(Jobs)
should_transfer_files = YES
when_to_transfer_output = ON_EXIT
transfer_input_files = dijet.tgz,/tmp/x509up_u55261,inputFileListLarge
transfer_output_files = /tmp/results.root
transfer_output_remaps = "/tmp/results.root=results$(Process).root"
+ProjectName = "atlas-org-fresnostate"
queue $(Jobs)
*******************88
Jobs = 5
getenv     = false
executable   = SmallD3PD.sh
output     = output/SmallD3PD.out.$(Process)
error     Â= error/SmallD3PD.error.$(Process)
log      Â= log/SmallD3PD.log.$(Process)
arguments = $(Process) $(Jobs)
should_transfer_files = YES
when_to_transfer_output = ON_EXIT
transfer_input_files = dijet.tgz,/tmp/x509up_u55261,inputFileListLarge
transfer_output_remaps = "/tmp/results.root ; results.root.$(Process)"
+ProjectName = "atlas-org-fresnostate"
queue $(Jobs)

On Mon, Sep 15, 2014 at 11:13 AM, Dr. Harinder Singh Bawa <harinder.singh.bawa@xxxxxxxxx> wrote:
Hi Ben and Walid,

transfer_output_remaps doesn't seem to work.

ÂInfact, I am not getting output strings which I use to get during my job. Somehow, this command interfered with my outfile (Normal text file) which I use to get to see normal course of my job.

Only I am getting error files which shows only warnings but my jobs seem to be running perfectly.

Harinder

Jobs = 5
getenv     = false
executable   = SmallD3PD.sh
output     = output/SmallD3PD.out.$(Process)
error     Â= error/SmallD3PD.error.$(Process)
log      Â= log/SmallD3PD.log.$(Process)
arguments = $(Process) $(Jobs)
should_transfer_files = YES
when_to_transfer_output = ON_EXIT
transfer_input_files = dijet.tgz,/tmp/x509up_u55261,inputFileListLarge
transfer_output_remaps = "/tmp/results.root ; results.root.$(Process)"
+ProjectName = "atlas-org-fresnostate"
queue $(Jobs)



Now, using above, I am getting only error files in error dir.Â

Outfile in output dir is blank.

and I dont see any results.root.1 or 2.... in my submission dir.


Here is error file: ÂBUT MY OUTfile is empty and no results.root

*********************************************

Info in <D3PD::TrigConfigSvcD3PD::Initialize>: Loaded configuration: SMK: 1487, L1PSK: 8982, HLTPSK: 7241
Info in <D3PD::TrigConfigSvcD3PD::Initialize>: Loaded configuration: SMK: 1487, L1PSK: 8982, HLTPSK: 7241
createSmallNtupleForDijetMassResonances --config Â--list inputFileList Â41.63s user 2.36s system 1% cpu 1:07:21.24 total

Harinder






On Mon, Sep 15, 2014 at 8:02 AM, Dr. Harinder Singh Bawa <harinder.singh.bawa@xxxxxxxxx> wrote:
Great!

Thanks
Harinder

On Mon, Sep 15, 2014 at 8:00 AM, Ben Cotton <ben.cotton@xxxxxxxxxxxxxxxxxx> wrote:
On Mon, Sep 15, 2014 at 10:38 AM, Dr. Harinder Singh Bawa
<harinder.singh.bawa@xxxxxxxxx> wrote:
>
> 1. Is there any shortcut command for this. I am asking because if I have more than 100 jobs, then I dont need to write hundred file name.
>
> 2. I have files in /tmp/test.root on execution node, so I suppose I have to do
>
> transfer_output_remaps `` /tmp/name newname ; /tmp/name2 newname2 ... ''
>
It applies per job, so the following should work:

transfer_output_remaps = "/tmp/test.root ; test.root.$(Process)"


Thanks,
BC

--
Ben Cotton
main: 888.292.5320

Cycle Computing
Leader in Utility HPC Software

http://www.cyclecomputing.com
twitter: @cyclecomputing
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/



--
Dr. Harinder Singh Bawa

ÂÂÂÂÂÂÂÂÂÂ Â Â ÂÂÂ Â Â Â Â Â Â Â Â Â Â Â Â
[web][facebook][youtube][twitter]
California State University, Fresno Logo




--
Dr. Harinder Singh Bawa

ÂÂÂÂÂÂÂÂÂÂ Â Â ÂÂÂ Â Â Â Â Â Â Â Â Â Â Â Â
[web][facebook][youtube][twitter]
California State University, Fresno Logo




--
Dr. Harinder Singh Bawa

ÂÂÂÂÂÂÂÂÂÂ Â Â ÂÂÂ Â Â Â Â Â Â Â Â Â Â Â Â
[web][facebook][youtube][twitter]
California State University, Fresno Logo


_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/


_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/



--
Dr. Harinder Singh Bawa

ÂÂÂÂÂÂÂÂÂÂ Â Â ÂÂÂ Â Â Â Â Â Â Â Â Â Â Â Â
[web][facebook][youtube][twitter]
California State University, Fresno Logo