Re: [HTCondor-users] condor_history with named pipes w/o seek?

[Thomas Hartmann <thomas.hartmann@xxxxxxx>]

Hi Carsten,

thanks for the confirmation :)

yes, I painted myself somewhat into a corner here - probably the 
'simplest' might be to unpack/parse/free/repeat in batches of the 
archived histories.

Cheers and thanks,
  Thomas

On 14/10/2021 12.11, Carsten Aulbert wrote:
> Hi
>
> On 14.10.21 12:01, Thomas Hartmann wrote:
> > Probably condor_history is doing a seek - which probably does not 
> > really harmonize with the pipe's stream, or?
>
> it does as
>
> strace -f condor_history -file <(zcat history.gz)
>
> ends with
>
> openat(AT_FDCWD, "/proc/self/fd/11", O_RDONLY) = 3
> fcntl(3, F_GETFL)ÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ = 0x8000 (flags 
> O_RDONLY|O_LARGEFILE)
> fstat(3, {st_mode=S_IFIFO|0600, st_size=0, ...}) = 0
> fstat(3, {st_mode=S_IFIFO|0600, st_size=0, ...}) = 0
> lseek(3, 0, SEEK_END)ÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ = -1 ESPIPE (Illegal seek)
> lseek(3, 0, SEEK_CUR)ÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ = -1 ESPIPE (Illegal seek)
> lseek(3, -4096, SEEK_SET)ÂÂÂÂÂÂÂÂÂÂÂÂÂÂ = -1 ESPIPE (Illegal seek)
> lseek(3, 0, SEEK_SET)ÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ = -1 ESPIPE (Illegal seek)
> close(3)ÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ = 0
>
> unfortunately, I don't know of any method to make named pipes seek-able 
> or condor_history work on compressed files :(
>
> Just uncompress to /dev/shm, work on it and remove it again?
>
> Sorry, for not being really helpful
>
> Carsten

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature