[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] General file stage-in Condor-G


The problem I have with this approach is that,
for Globus 4, I need to pass within
<fileStageine> the <transferCredentialEndpoint>
element which points to a delegation
service resource on the target GRAM.

However, when the job is submitted,
Condor-G matchmaking has not been done yet,
so the host/container running the delegation
service is not yet known.

In other words, there are two mechanisms,
but none of them probves both access to a
remote file system and delegation of credential
to the matched GT 4 resource:

 1. For transfer_input_files, Condor-G inserts
    <transferCredentialEndpoint> after matchmaking
    but does not allow to specify the file as a URL;

 2. For globus_xml = <fileStageIn>...</fileStageIn>
    one can specify a remote file, but it cannot be
    used with matchmaking since the client must
    specify <transferCredentialEndpoint> and
    at the time the job is submitted this is
    not known (unless the job is bound to a
    certain GT 4 resource, i.e., no matchmaking).

So I am looking for a mechanism that combines
the functionality of transfer_input_files
and fileStageIn.


> Hi,
> not really a clean solution, but you can always pass file_stage_in
> parameter directly to Globus GRAM with globusrsl attribute.
> Cheers,
> emir
> Gabriel Mateescu wrote:
>> Hello,
>> I would like to do file stage-in in Condor-G,
>> such that the source file is not on the file
>> system local to Condor-G, but on a remote
>> GridFTP server.
>> Condor-G supports staging-in files from the
>> submit machine to a GT4 Grid Resource, e.g.,
>>   transfer_input_files = /path/to/file
>> is translated by Condor-G to
>> <fileStageIn>
>> <transfer>
>>  <sourceUrl>gsiftp://LOCAL_HOSTNAME:40000/path/to/file</sourceUrl>
>> <destinationUrl>file:///${GLOBUS_SCRATCH_DIR}/job_HASH/file/</destinationUrl>r
>> </transfer>
>> </fileStageIn>
>> which works well since Condor-G starts a local
>> GridFTP server.
>> Assume now that the input file is on another machine
>> with a GridFTP service, call it FILESERVER.
>> Then I would like to have the semantics of
>>   transfer_input_files = gsiftp://FILESERVER/path/to/file
>> but Condor does not allow the value of transfer_input_file
>> to be the URL of a remote file.
>> Is there another way to achieve this functionality?
>> Thank you.
>> Gabriel
>> _______________________________________________
>> Condor-users mailing list
>> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with
>> a
>> subject: Unsubscribe
>> You can also unsubscribe by visiting
>> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>> The archives can be found at either
>> https://lists.cs.wisc.edu/archive/condor-users/
>> http://www.opencondor.org/spaces/viewmailarchive.action?key=CONDOR