Re: [HTCondor-users] python3.6

[Larry Martell <larry.martell@xxxxxxxxx>]

Yes, in 2.7 the jobs run successfully.

I want the output file transferred.

I changed transfer_output to 'True' and now the jobs are running, but
they are failing. But that is some progress. Now to figure out why.
Thanks.

On Wed, Aug 7, 2019 at 5:52 PM Josh Karpel via HTCondor-users
<htcondor-users@xxxxxxxxxxx> wrote:
>
> Odd - I'm not sure why that would work in 2.7 but not in 3.6, because I think it should fail in both. Presumably the 2.7 code is not as strict as 3.6. The legal values of transfer_output are True and False (see https://htcondor.readthedocs.io/en/latest/man-pages/condor_submit.html)
>
> Do the jobs appear in the queue if you submit them from 2.7? What's your intended output transfer behavior?
>
> Josh Karpel
> karpel@xxxxxxxx
>
>
> On Wed, Aug 7, 2019 at 4:43 PM Larry Martell <larry.martell@xxxxxxxxx> wrote:
>>
>>           submit_dict = {
>>              'universe': 'vanilla',
>>              'executable':
>> MODULE_SOURCE_FOR_CLUSTER+'CAPbase/capcompute/util/tasks/compute_radiology.py',
>>              'arguments': str(args),
>>              'output': os.path.join(log_dir, 'compute_radiology.out.'
>> + extention),
>>              'error': os.path.join(log_dir, 'compute_radiology.err.' +
>> extention),
>>              'log': log_file,
>>              'should_transfer_files': 'YES',
>>              'when_to_transfer_output': 'ON_EXIT',
>>              'transfer_output': 'output',
>>              'Initialdir': SYSTEM_ROOT+'/elucid/Cluster/tmp',
>>              'getenv': 'True',
>>              'leave_in_queue': '(JobStatus == 4)',
>>           }
>>          submits.append(htcondor.Submit(submit_dict))
>>
>> Also my jobs are not running - I never see them in the queue. But this
>> code works in 2.7 fails in 3.6.
>>
>>
>> On Wed, Aug 7, 2019 at 5:31 PM Josh Karpel via HTCondor-users
>> <htcondor-users@xxxxxxxxxxx> wrote:
>> >
>> > Hi Larry,
>> >
>> > Could you include the code where you make the Submit objects? That's probably where the error is originating, although you don't see it until you actually try to submit the jobs.
>> >
>> > Josh Karpel
>> > karpel@xxxxxxxx
>> >
>> >
>> > On Wed, Aug 7, 2019 at 3:18 PM Larry Martell <larry.martell@xxxxxxxxx> wrote:
>> >>
>> >> I have a script that works in python2.7, but when I run it in 3.6 it
>> >> fails. The code that fails is here:
>> >>
>> >>           with schedd.transaction() as txn:
>> >>               for i, submit in enumerate(submits):
>> >>                   id = submit.queue(txn)
>> >>                   id_map[id] = i
>> >>                   job_ids.append(id)
>> >>
>> >> The error is on the submit.queue:
>> >>
>> >> RuntimeError: transfer_output=output is invalid, must eval to a boolean.
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/