Mailing List Archives
Public Access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Condor-users] General file stage-in Condor-G
- Date: Fri, 7 Jul 2006 10:51:39 -0400 (EDT)
- From: "Gabriel Mateescu" <gabriel.mateescu@xxxxxx>
- Subject: Re: [Condor-users] General file stage-in Condor-G
Hi,
The problem I have with this approach is that,
for Globus 4, I need to pass within
<fileStageine> the <transferCredentialEndpoint>
element which points to a delegation
service resource on the target GRAM.
However, when the job is submitted,
Condor-G matchmaking has not been done yet,
so the host/container running the delegation
service is not yet known.
In other words, there are two mechanisms,
but none of them probves both access to a
remote file system and delegation of credential
to the matched GT 4 resource:
1. For transfer_input_files, Condor-G inserts
<transferCredentialEndpoint> after matchmaking
but does not allow to specify the file as a URL;
2. For globus_xml = <fileStageIn>...</fileStageIn>
one can specify a remote file, but it cannot be
used with matchmaking since the client must
specify <transferCredentialEndpoint> and
at the time the job is submitted this is
not known (unless the job is bound to a
certain GT 4 resource, i.e., no matchmaking).
So I am looking for a mechanism that combines
the functionality of transfer_input_files
and fileStageIn.
Thanks.
Gabriel
> Hi,
>
> not really a clean solution, but you can always pass file_stage_in
> parameter directly to Globus GRAM with globusrsl attribute.
>
> Cheers,
> emir
>
> Gabriel Mateescu wrote:
>> Hello,
>>
>> I would like to do file stage-in in Condor-G,
>> such that the source file is not on the file
>> system local to Condor-G, but on a remote
>> GridFTP server.
>>
>> Condor-G supports staging-in files from the
>> submit machine to a GT4 Grid Resource, e.g.,
>>
>> transfer_input_files = /path/to/file
>>
>> is translated by Condor-G to
>>
>> <fileStageIn>
>> <transfer>
>> <sourceUrl>gsiftp://LOCAL_HOSTNAME:40000/path/to/file</sourceUrl>
>>
>> <destinationUrl>file:///${GLOBUS_SCRATCH_DIR}/job_HASH/file/</destinationUrl>r
>> </transfer>
>> </fileStageIn>
>>
>> which works well since Condor-G starts a local
>> GridFTP server.
>>
>> Assume now that the input file is on another machine
>> with a GridFTP service, call it FILESERVER.
>> Then I would like to have the semantics of
>>
>> transfer_input_files = gsiftp://FILESERVER/path/to/file
>>
>> but Condor does not allow the value of transfer_input_file
>> to be the URL of a remote file.
>>
>> Is there another way to achieve this functionality?
>>
>> Thank you.
>> Gabriel
>>
>>
>>
>> _______________________________________________
>> Condor-users mailing list
>> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with
>> a
>> subject: Unsubscribe
>> You can also unsubscribe by visiting
>> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>>
>> The archives can be found at either
>> https://lists.cs.wisc.edu/archive/condor-users/
>> http://www.opencondor.org/spaces/viewmailarchive.action?key=CONDOR
>