Re: [Condor-users] about submitting job programmably to Condor Windows cluster

[Hui Li <t-huil@xxxxxxxxxxxxx>]

Hi Matt,

We are trying to make a MapReduce execution engine run on top of the Condor Windows Cluster. 
Currently we just want to run the mapreduce job locally on Condor cluster, so DRMAA is preferred to obtain the better performance for the mapreduce job. 
Maybe, in the future, we will try submit the mapreudce job remotely to Condor cluster with SOAP (similar to Amazon elastic mapreduce) 
If we get some result about the performance stuff about SOAP vs DRMAA or the CLI, we will share with the Condor community. 

Thanks,
Hui


-----Original Message-----
From: condor-users-bounces@xxxxxxxxxxx [mailto:condor-users-bounces@xxxxxxxxxxx] On Behalf Of Matthew Farrellee
Sent: Tuesday, July 20, 2010 4:39 AM
To: Condor-Users Mail List
Subject: Re: [Condor-users] about submitting job programmably to Condor Windows cluster

Will you elaborate on the performance problems with the SOAP interface vs DRMAA or the CLI?

Best,


matt

On 07/17/2010 12:11 PM, Hui Li wrote:
> Hi Ben,
> 
> Thank you very much for the help!
> We use a mixture of managed and unmanaged C++ code. Our program will 
> run on local Condor cluster, so we prefer DRMAA and command line tools 
> for the performance issue.
> 
> Regards,
> Hui
> 
> On Sat, Jul 17, 2010 at 1:22 AM, Burnett, Ben <ben.burnett@xxxxxxxx> wrote:
>> I'll let someone else field the DRMAA questions, I've not had a chance to use it, so I can't comment on it.
>>
>> As far as another API, there is the SOAP interface (or the command line tools).  Are you planing on using managed or unmanaged C++ on Windows?  If you are using managed C++, then you can use the wsdl.exe tool like so to generate C++ stubs:
>>
>> wsdl 
>> /l:Microsoft.MCpp.MCppCodeProvider,MCppCodeDomProvider,Version=7.0.50
>> 00.0,Culture=Neutral,PublicKeyToken=b03f5f7f11d50a3a /nologo 
>> /sharetypes /namespace:Condor \  
>> file:/c:/condor/lib/webservice/condorCollector.wsdl \  
>> file:/c:/condor/lib/webservice/condorSchedd.wsdl \  /out:condor.h
>>
>> For more detail, see here:
>> http://ben.versionzero.org/wiki/Condor_SOAP_Interface
>>
>> Otherwise, gSOAP or the Microsoft SOAP Toolkit might fit your needs.  The former is still being actively developed, while the latter isn't, but may be structured in a more familiar way, if you are coming from a Windows development background.
>>
>> Regards,
>> -B
>>
>>
>> On 2010-07-16, at 11:12 PM, Hui Li wrote:
>>
>>> Hi All,
>>>
>>> I want to make some extension that need submitting job programmably 
>>> to Condor cluster run on top of Windows machines. The Condor version 
>>> I used is condor-7.4.2-winnt50-x86. There is example about using the 
>>> DRMAA lib, however, I found that some source files is not completed 
>>> version. For example, there are many "TODO" in the libDrmaa.c file.
>>> Could anybody tell me how to obtain the completed version of DRMAA 
>>> source code? Besides, is there some Condor native API that I can 
>>> used to submit Condor job with C++ on Windows platform.  Any 
>>> suggestion will be appreciated!
>>>
>>> Thanks,
>>> Hui
>>> _______________________________________________
>>> Condor-users mailing list
>>> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx 
>>> with a
>>> subject: Unsubscribe
>>> You can also unsubscribe by visiting 
>>> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>>>
>>> The archives can be found at:
>>> https://lists.cs.wisc.edu/archive/condor-users/
>>
>> _______________________________________________
>> Condor-users mailing list
>> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx 
>> with a
>> subject: Unsubscribe
>> You can also unsubscribe by visiting
>> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>>
>> The archives can be found at:
>> https://lists.cs.wisc.edu/archive/condor-users/
>>
> 
> 
> 

_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/condor-users/