[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Condor-users] Disk IO
- Date: Thu, 7 Jun 2012 16:47:40 -0400
- From: Tiago Macarios <tiagomacarios@xxxxxxxxx>
- Subject: [Condor-users] Disk IO
I have a particular problem, if someone could help me I would really appreciate.
I have a condor pool of approx 30 machines, this machines run jobs that are disk and CPU intensive, but lately the jobs are more disk IO intensive than CPU intensive. This is causing some machines to actually IDLE while the disk is seeking. These machines can run 32 processes at a time, but currently I have to enforce a limit of 8 per machine (heuristic value), because of the disk.
The machines already have 4 disks each. I was wondering if there is a way I could create a concurrency limit for disks and make condor copy and run the files on the different disks enforcing the 8 jobs per disk. The problem is that how can I get a variable that tells me which disk I should copy things to?