[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] JobWrapper fails to execute after upgrade to 8.8.11



Hi Greg, all,

Setting
MOUNT_UNDER_SCRATCH = ""
on the worker did it! Thanks a lot!

We were using the default setting, which changed from v8.6 to v8.8.
Could this be worth adding to the "Upgrading from the 8.6 series to the 8.8 series of HTCondorâ  [0] documentation? The error message really is nonindicative for the issue/cause.

Cheers,
Max

[0]
https://htcondor.readthedocs.io/en/v8_8/version-history/upgrading-from-86-to-88-series.html

On 24. Nov 2020, at 17:14, Greg Thain <gthain@xxxxxxxxxxx> wrote:


On 11/24/20 10:06 AM, max.fischer@xxxxxxx wrote:
Hi Greg, all,

The EXECUTE is /tmp/condor_execute


Try setting

MOUNT_UNDER_SCRATCH =


in the worker node config file


-greg


Some more working points:

- Scientific Linux release 7.8 (Nitrogen)
- I tried several 8.8 versions (8.8.10, 8.8.9, 8.8.6, 8.8.0) but encountered the same issue. Moving back to 8.6.13 fixes the issue. Re-installing the machine still replicates the same behaviour (8.8 fails, 8.6 works).
- Issue occurs with and without job wrapper. See e.g. [0] of launching an interactive job without wrapper.
- Issue occurs with and without cgroups.
- I have a suspicion this will turn out to be something *really* embarrassing for our setupâ :D

Cheers,
Max

On 24. Nov 2020, at 16:33, Greg Thain <gthain@xxxxxxxxxxx> wrote:


Where is your execute directory located?  Is it under /tmp, /var/tmp or other directory that is getting privately mapped for the job?

-greg


On 11/24/20 9:27 AM, thomas.hartmann@xxxxxxx wrote:
do symlinks might be a problem? 
I.e., with /bin --> /usr/bin somehow(??) colliding with the wrapper's shebang 

On 24/11/2020 03.27, dmaziuk via HTCondor-users wrote: 
On 11/23/2020 12:11 PM, mdidomenico4@xxxxxxxxx wrote: 
... i'm not able to discern why you 
might get 'bad interpreter", thought maybe it was a bogus message 
masking something else 

if job's chroot'ed and there's no /bin maybe? -- just a thought. 

Dimitri 

_______________________________________________ 
HTCondor-users mailing list 
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a 
subject: Unsubscribe 
You can also unsubscribe by visiting 
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users 

The archives can be found at: 
https://lists.cs.wisc.edu/archive/htcondor-users/ 


_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/


_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

Attachment: smime.p7s
Description: S/MIME cryptographic signature