[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] change spool file location from the local administration machine to a network one



--On March 25, 2013 9:10:57 AM -0500 Christopher Harrison <harrison@xxxxxxxxxxxxxxxx> wrote:

I might recommend a SSD for the submit machine's "spool" area.   I have
experienced extremely fast io access, reduced latency and improved
throughput just by installed the ssd's.   Just one item you might want to
consider.

I actively discourage the use of flash-based SSDs for anything that qualifies as mission critical. They're expensive, they're disposable, and they're not reliable under power faults. Use RAM-based SSDs instead. They cost more than flash but they're faster than flash, they're more dependable than flash, and they don't have limited write life like flash.

If you want to do it on the cheap then try a RAM disk on the master for spooling submissions. You lose the dependability of battery-backed RAM so you lose your entire spool area on a power fault but that's what going cheap gets you. :)

--
Rich Pieri <ratinox@xxxxxxx>
MIT Laboratory for Nuclear Science