Re: [HTCondor-users] HTCondor and OS architecture

[Thomas Hartmann <thomas.hartmann@xxxxxxx>]

Hi Stefano,

beware: I am no Windows person in any kind ;)

My approach would be to try to run my binary manually/locally and if
everything works as expected try it interactively via Condor.

btw: Microsoft has added support for a Docker/Linux subsystem with
recent Windows versions (afaik shipping some small Linux kernel to do
the dirty work) - some it *might* be possible so run your Linux bins in
a container ontop of Win

https://blogs.msdn.microsoft.com/premier_developer/2018/04/20/running-docker-windows-and-linux-containers-simultaneously/
But I have no idea, how/if Docker@Win is supported by Condor, how
permissions/users/... are handled, etc. pp. - so might there might be a
lot of dragons ;)

Cheers,
  Thomas

On 2018-10-16 18:51, Stefano Colafranceschi - Mathematical Sciences Dept
wrote:
> Thanks for your answer!
> 
> So basically as my HTCondor pool at the moment is 99% windows based (I canât change that..) to submit compiled software from my Linux I would use mingw32 compiler that seems to produce windows binaries compatibles (although I never used it). Do you think that will work? Anybody opted for this solution?
> 
> StefanoC
> 
>> On Oct 16, 2018, at 10:08 AM, John M Knoeller <johnkn@xxxxxxxxxxx> wrote:
>>
>>> what do you mean by âMicrosoft plan to change thatâ? Something like ongoing on the Windows Kernel..?
>>
>> I would assume that this would be some sort of automatic handoff between the Windows task launcher and the Linux subsystem. 
>> But as far as I know, such a think doesn't work now. 
>>
>>> If I get WINE on Linux and Docker on Windows I might be able to run the Linux compiled jobs on windows nodes (hopefully with Docker) and
>>> Windows compiled jobs on Linux nodes (hopefully with WINE), is it something feasible or the entropy will take things over?
>>
>> Docker jobs running on Windows is not currently something we support, and adding support is not on our near term work list.  
>>
>> Running Windows jobs on Linux will probably work for some jobs - but I don't really know a lot about WINE, so I can't really be helpful there.
>>
>> -tj
>>
>> -----Original Message-----
>> From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> On Behalf Of Stefano Colafranceschi - Mathematical Sciences Dept
>> Sent: Monday, October 15, 2018 9:42 AM
>> To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
>> Subject: Re: [HTCondor-users] HTCondor and OS architecture
>>
>>
>> If I get WINE on Linux and Docker on Windows I might be able to run the Linux compiled jobs on windows nodes (hopefully with Docker) and Windows compiled jobs on Linux nodes (hopefully with WINE), is it something feasible or the entropy will take things over?
>>
>> StefanoC
>>
>>> On Oct 15, 2018, at 10:23 AM, John M Knoeller <johnkn@xxxxxxxxxxx> wrote:
>>>
>>> You can submit jobs from Linux and run them on Windows and viseversa.  But the you must specify in your submit file the target OpSys of the job, By default, submitted jobs have
>>>
>>> OpSys == âLINUXâ or OpSys == âWINDOWSâ
>>>
>>> Added to their Requirements expression, so that they will only match machines that are the same operating system as were they are submitted.
>>>
>>> If you specify Requirements in your submit file, and if that Requirements expression uses OpSys, then the default OpSys requirement is disabled.
>>>
>>> As for running jobs.  Jobs that are compiled to run on a Linux machine will *not* run on a Windows machine (and visaversa). Although Microsoft has said they plan to change that â and for running Windows on Linux there is WINE â but HTCondor does not do anything special to make jobs run in a cross-platform way.  It is up to you to specify Requirements so that you jobs will only match machines that the jobs can run on â and to install cross-platform software on your execute nodes if necessary.
>>>
>>> -tj
>>>
>>> From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> On Behalf Of Stefano Colafranceschi
>>> Sent: Sunday, October 14, 2018 5:38 PM
>>> To: htcondor-users@xxxxxxxxxxx
>>> Subject: [HTCondor-users] HTCondor and OS architecture
>>>
>>> Hi,
>>> Perhaps trivial question whose answer maybe present in some online manual but I couldn't find it..
>>>
>>> In my case I am installing HTcondor on win and Linux machines, I am wondering if Linux nodes will be able to work on jobs compiled/submitted from win and viceversa?
>>>
>>> Thanks!
>>>
>>> StefanoC
>>> _______________________________________________
>>> HTCondor-users mailing list
>>> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
>>> subject: Unsubscribe
>>> You can also unsubscribe by visiting
>>> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>>>
>>> The archives can be found at:
>>> https://lists.cs.wisc.edu/archive/htcondor-users/
>>
>>
>> _______________________________________________
>> HTCondor-users mailing list
>> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
>> subject: Unsubscribe
>> You can also unsubscribe by visiting
>> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>>
>> The archives can be found at:
>> https://lists.cs.wisc.edu/archive/htcondor-users/
>>
>> _______________________________________________
>> HTCondor-users mailing list
>> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
>> subject: Unsubscribe
>> You can also unsubscribe by visiting
>> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>>
>> The archives can be found at:
>> https://lists.cs.wisc.edu/archive/htcondor-users/
> 
> 
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> 
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/
>

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature