I need to run a lot (approx. 4000) jobs which use the same input file, only with different parameters.
We don’t have nfs.
How can I distribute the amount of system calls to the computer? I fear that if too much machines will run those jobs at the same time, and will perform multiple I/O system calls simultaneously, the connection will crush. (or will automatically disconnect due to network regulation). I know I can limit the amount of jobs which run at the same time, but isn’t there a more efficient way?
Vale et me ama