Re: [Condor-users] General file stage-in Condor-G

["Gabriel Mateescu" <gabriel.mateescu@xxxxxx>]

Hi,

The problem I have with this approach is that,
for Globus 4, I need to pass within
<fileStageine> the <transferCredentialEndpoint>
element which points to a delegation
service resource on the target GRAM.

However, when the job is submitted,
Condor-G matchmaking has not been done yet,
so the host/container running the delegation
service is not yet known.

In other words, there are two mechanisms,
but none of them probves both access to a
remote file system and delegation of credential
to the matched GT 4 resource:

 1. For transfer_input_files, Condor-G inserts
    <transferCredentialEndpoint> after matchmaking
    but does not allow to specify the file as a URL;

 2. For globus_xml = <fileStageIn>...</fileStageIn>
    one can specify a remote file, but it cannot be
    used with matchmaking since the client must
    specify <transferCredentialEndpoint> and
    at the time the job is submitted this is
    not known (unless the job is bound to a
    certain GT 4 resource, i.e., no matchmaking).

So I am looking for a mechanism that combines
the functionality of transfer_input_files
and fileStageIn.

Thanks.
Gabriel


> Hi,
>
> not really a clean solution, but you can always pass file_stage_in
> parameter directly to Globus GRAM with globusrsl attribute.
>
> Cheers,
> emir
>
> Gabriel Mateescu wrote:
>> Hello,
>>
>> I would like to do file stage-in in Condor-G,
>> such that the source file is not on the file
>> system local to Condor-G, but on a remote
>> GridFTP server.
>>
>> Condor-G supports staging-in files from the
>> submit machine to a GT4 Grid Resource, e.g.,
>>
>>   transfer_input_files = /path/to/file
>>
>> is translated by Condor-G to
>>
>> <fileStageIn>
>> <transfer>
>>  <sourceUrl>gsiftp://LOCAL_HOSTNAME:40000/path/to/file</sourceUrl>
>>
>> <destinationUrl>file:///${GLOBUS_SCRATCH_DIR}/job_HASH/file/</destinationUrl>r
>> </transfer>
>> </fileStageIn>
>>
>> which works well since Condor-G starts a local
>> GridFTP server.
>>
>> Assume now that the input file is on another machine
>> with a GridFTP service, call it FILESERVER.
>> Then I would like to have the semantics of
>>
>>   transfer_input_files = gsiftp://FILESERVER/path/to/file
>>
>> but Condor does not allow the value of transfer_input_file
>> to be the URL of a remote file.
>>
>> Is there another way to achieve this functionality?
>>
>> Thank you.
>> Gabriel
>>
>>
>>
>> _______________________________________________
>> Condor-users mailing list
>> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with
>> a
>> subject: Unsubscribe
>> You can also unsubscribe by visiting
>> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>>
>> The archives can be found at either
>> https://lists.cs.wisc.edu/archive/condor-users/
>> http://www.opencondor.org/spaces/viewmailarchive.action?key=CONDOR
>