[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Condor-users] Managing millions of log files from large DAGs



How are people managing the O(1M) files generated by large DAGs (all the .out
and .err files) that show up in the same directory. There are a few filesystems
that scale well to having that many files in a single directory, but not many.

Thanks.

-- 
Stuart Anderson  anderson@xxxxxxxxxxxxxxxx
http://www.ligo.caltech.edu/~anderson