[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] nfs and condor



Steve,
I am very curious about the condor_transfer_files tricks. Ideally,
write to local drives and then tranfsfer the files back to submit host
or place them back into NFS.

Most of us see stdout and stderr when we submit jobs and look at their
progress. Would be still be able to do that with condor_transfer_files
?


On Sun, Jun 12, 2011 at 5:35 PM, Dimitri Maziuk <dmaziuk@xxxxxxxxxxxxx> wrote:
> On 06/12/2011 05:15 AM, Mag Gam wrote:
>> At our university we are a heavy NFS user. When we run run long jobs
>> with condor and there is a performance problem with our home
>> directories (which on are NFS). It seems the job gets requeued.
>>
>> I was wondering if anyone else out there have a similar problem and
>> what they did to fix it :-)
>
> Short answers are "yes" and "don't use nfs". For starters, move condor
> i/o out of the home directories and to a different nfs server. E.g. we
> are exporting a 2TB sata disk from our submit host for condor users to
> put their files on.
>
> Dimirti
> --
> Dimitri Maziuk
> Programmer/sysadmin
> BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu
>
>
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/condor-users/
>
>