Re: [HTCondor-users] python3.6

[John M Knoeller <johnkn@xxxxxxxxxxx>]

you want a file called output transferred?  that would be

transfer_output_files = output

Although I think what you mean to say is that you want 'compute_radiology.out ' + extension transferred.

to do that you would use

transfer_output = true

not 

transfer_output = output 

which is always an error.   If this is *not* failing on python 2.7 then *that* is a bug.

transfer_output = true

is also the default when WHEN_TO_TRANSFER_FILES is not false, so you don't actually need that line at all,
that may be why it is working on python 2.7

-tj

-----Original Message-----
From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> On Behalf Of Larry Martell
Sent: Wednesday, August 7, 2019 5:13 PM
To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Subject: Re: [HTCondor-users] python3.6

Yes, in 2.7 the jobs run successfully.

I want the output file transferred.

I changed transfer_output to 'True' and now the jobs are running, but
they are failing. But that is some progress. Now to figure out why.
Thanks.

On Wed, Aug 7, 2019 at 5:52 PM Josh Karpel via HTCondor-users
<htcondor-users@xxxxxxxxxxx> wrote:
>
> Odd - I'm not sure why that would work in 2.7 but not in 3.6, because I think it should fail in both. Presumably the 2.7 code is not as strict as 3.6. The legal values of transfer_output are True and False (see https://htcondor.readthedocs.io/en/latest/man-pages/condor_submit.html)
>
> Do the jobs appear in the queue if you submit them from 2.7? What's your intended output transfer behavior?
>
> Josh Karpel
> karpel@xxxxxxxx
>
>
> On Wed, Aug 7, 2019 at 4:43 PM Larry Martell <larry.martell@xxxxxxxxx> wrote:
>>
>>           submit_dict = {
>>              'universe': 'vanilla',
>>              'executable':
>> MODULE_SOURCE_FOR_CLUSTER+'CAPbase/capcompute/util/tasks/compute_radiology.py',
>>              'arguments': str(args),
>>              'output': os.path.join(log_dir, 'compute_radiology.out.'
>> + extention),
>>              'error': os.path.join(log_dir, 'compute_radiology.err.' +
>> extention),
>>              'log': log_file,
>>              'should_transfer_files': 'YES',
>>              'when_to_transfer_output': 'ON_EXIT',
>>              'transfer_output': 'output',
>>              'Initialdir': SYSTEM_ROOT+'/elucid/Cluster/tmp',
>>              'getenv': 'True',
>>              'leave_in_queue': '(JobStatus == 4)',
>>           }
>>          submits.append(htcondor.Submit(submit_dict))
>>
>> Also my jobs are not running - I never see them in the queue. But this
>> code works in 2.7 fails in 3.6.
>>
>>
>> On Wed, Aug 7, 2019 at 5:31 PM Josh Karpel via HTCondor-users
>> <htcondor-users@xxxxxxxxxxx> wrote:
>> >
>> > Hi Larry,
>> >
>> > Could you include the code where you make the Submit objects? That's probably where the error is originating, although you don't see it until you actually try to submit the jobs.
>> >
>> > Josh Karpel
>> > karpel@xxxxxxxx
>> >
>> >
>> > On Wed, Aug 7, 2019 at 3:18 PM Larry Martell <larry.martell@xxxxxxxxx> wrote:
>> >>
>> >> I have a script that works in python2.7, but when I run it in 3.6 it
>> >> fails. The code that fails is here:
>> >>
>> >>           with schedd.transaction() as txn:
>> >>               for i, submit in enumerate(submits):
>> >>                   id = submit.queue(txn)
>> >>                   id_map[id] = i
>> >>                   job_ids.append(id)
>> >>
>> >> The error is on the submit.queue:
>> >>
>> >> RuntimeError: transfer_output=output is invalid, must eval to a boolean.
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/