[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] [EXTERNAL] Re: Sample R jobs on Windows



Hi Steve,

ÂThe zip file is >25 GB. However, here's an example on somebody else's github page:Âhttps://github.com/lawinslow/condor-examples/tree/master/R-Rtools-sandbox

Basically, it is the install files and paths from R.Â

RichieÂÂ

On Fri, Sep 20, 2019 at 1:41 PM Scheel, Stephen <scheel@xxxxxxxxxxxxx> wrote:

Hi again Richie et al.,

Â

Going through the projects Richie has linked below (Thank you so much Richie!!!) I have found that they are pretty extensive but I couldnât find the R.ZIP and environmental files. Would you be able to provide these?

Â

Weâre really new to this work and donât have this kind of expertise in our shop.Â

Â

Thanks for any help!

Â

Stephen Scheel // Network Manager

Â

Miami Business School

5250 University Drive, Jenkins Bldg 211D

Coral Gables, FL 33146

email: scheel@xxxxxxxxxxxxx
office: 305-284-5449
fax: 305-284-9284

Â

From: Richard Erickson <rerickson@xxxxxxxx>
Sent: Thursday, September 19, 2019 10:56 AM
To: Scheel, Stephen <scheel@xxxxxxxxxxxxx>
Cc: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Subject: Re: [HTCondor-users] [EXTERNAL] Re: Sample R jobs on Windows

Â

Youâre welcome. I would start with the paper. âSand boxingâ code is one hard part for HTCondor (the other hard part is creating small jobs)

Â

Richie


On Sep 19, 2019, at 9:27 AM, Scheel, Stephen <scheel@xxxxxxxxxxxxx> wrote:

Richie,

Â

Thank you very much for this and the quick reply â this is quite a bit to dissect. I have some research to do regarding the âDocker Universeâ that you mentioned here.Â

Â

Again,

Â

Thank you!

Â

From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> On Behalf Of Richard Erickson via HTCondor-users
Sent: Wednesday, September 18, 2019 3:35 PM
To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Cc: Richard Erickson <rerickson@xxxxxxxx>
Subject: Re: [HTCondor-users] [EXTERNAL] Re: Sample R jobs on Windows

Â

Steve,

Â

Please see my examples, note the usgs bit bucket git repo will be moving to code.usgs.gov sometime this fall

Â

And open access tutorial

ÂMore generally, I find the Docker universe to be better for running r jobs. But, I do have an example for native windowsÂ

Â

Here are other example projects

Â

The last one is 4 yrs old, but uses windows batch files.

Â

Richie

Â

Â

Â

Â


On Sep 18, 2019, at 3:07 PM, Scheel, Stephen <scheel@xxxxxxxxxxxxx> wrote:

Good morning


We are trying to get our HTCondor cluster to be usable for R job submissions. Our central manager worker and submission nodes are windows based machines. All of the worker nodes have R installed in the default paths. We are trying to get some basic R jobs submitted as a proof of concept here but no one really knows how to use actually package, and submit jobs. I have successfully and tested the generic sleep.sub job and can submit many jobs with this. What we would like is to have a sample R job that we can dissect and reverse engineer to start our submissions.

Â

Any assistance would be very much appreciated.

Â

Thanks,

Â

Steve

Â

Stephen Scheel // Network Manager

Â

Miami Business School

5250 University Drive, Jenkins Bldg 211D

Coral Gables, FL 33146

email: scheel@xxxxxxxxxxxxx
office: 305-284-5449
fax: 305-284-9284

Â

Â

<image001.png><image002.png><image003.png>

<image004.jpg>

âThe information contained in this transmission may contain privileged and confidential

information, including information protected by federal and state privacy laws. It is

intended only for the use of the person(s) named above. If you are not the intended

recipient, you are hereby notified that any review, dissemination, distribution, or

duplication of this communication is strictly prohibited. If you are not the intended

recipient, please contact the sender by reply email and destroy all copies of the original

message.â

Â

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/



--
************ Richard Erickson, PhD 
O__ ----
Research QuantitativeÂEcologist c/ /'_ --- Upper Midwest Environmental Sciences Center (*) \(*) -- US Geological Survey ~~~~~~~~~~ - La Crosse, WI 54603
USGS "office hours" calendar: link