[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[HTCondor-users] incomplete output files



has anyone seen issues where jobs running in condor fail to completely
write out their output.

take this piece of code

#include <stdio.h>
#include <stdlib.h>
int main(int argc, char **argv)
{
unsigned char *c2;
char fname[256];
file *cf;
sprintf(fname, "/blah/blah.%s", argv[1]);
c2 = malloc((size_t) 256*128*256*128);
cf = fopen(fname, "w");
fwrite(c2,256*128*256*128,1,cf);
fflush(cf);
fclose(cf);
return(0);
}

if i run this with queue 30 under condor, some percentage of the files
will not write out their 1GB of data

if i run the exact same program outside of condor, using my
workstation, slurm, etc, it works fine.

we're running condor 8.8.6 and have cgroup controls turned on (but
it's only limiting memory).  otherwise we're not doing anything
special