„PRACE User Support” változatai közötti eltérés

Innen: KIFÜ Wiki
(Új oldal, tartalma: „PRACE User Support”)
 
1. sor: 1. sor:
PRACE User Support
+
                   
 +
==== Access with GSI-SSH ====
 +
 
 +
A user can access to the supercomputers by using the GSI-SSH protocol.
 +
 
 +
It requires a machine with a Globus installation that provides the gsissh client.
 +
 
 +
The needed credentials (these mean the private and public keys) must be created before entering the machine with the
 +
 
 +
<code>
 +
    grid-proxy-init
 +
</code>
 +
 
 +
command.
 +
 
 +
<br/>
 +
 
 +
To enter the site, the
 +
 
 +
<code>
 +
    gsissh -p 2222 login.budapest.hpc.niif.hu
 +
</code>
 +
 
 +
command has to be used.
 +
 
 +
<br />
 +
 
 +
==== GridFTP file transfer ====
 +
 
 +
 
 +
In order to use GridFTP for file transfer, one needs a GridFTP client program that provides the interface between the user and a remote GridFTP server. There are several clients available for GridFTP, one of which is globus-url-copy, a command line tool which can transfer files using the GridFTP protocol as well as other protocols such as http and ftp. globus-url-copy is distributed with the Globus Toolkit and usually available on machines that have the Globus Toolkit installed.
 +
 
 +
<br/>
 +
 
 +
'''Syntax'''
 +
 
 +
<code>
 +
    globus-url-copy [options] sourceURL destinationURL
 +
</code>
 +
 
 +
* [options] The optional command line switches as described later.
 +
 
 +
* sourceURL The URL of the file(s) to be copied. If it is a directory, it must end with a slash (/), and all files within that directory will be copied.
 +
 
 +
* destURL The URL to which to copy the file(s). To copy several files to one destination URL, destURL must be a directory and be terminated with a slash (/).
 +
 
 +
 
 +
Globus-url-copy supports multiple protocols, so the format of the source and destination URLs can be either
 +
 
 +
<code>
 +
    file://path
 +
</code>
 +
 
 +
 
 +
when you refer to a local file or directory or
 +
 
 +
<code>
 +
    protocol://host[:port]/path
 +
</code>
 +
 
 +
 
 +
when you refer to a remote file or directory.
 +
 
 +
globus-url-copy is supporting other protocols such as http, https, ftp and gsiftp as well.
 +
 +
 
 +
'''Command line options for globus-url-copy [options]'''
 +
 
 +
* -help Prints usage information for the globus-url-copy program.
 +
* -version Prints the version of the globus-url-copy program.
 +
* -vb During the transfer, displays: (1) number of bytes transferred (2) performance since the last update (every 5 seconds) (3) average performance for the whole transfer
 +
<br/>
 +
'''The following table lists parameters which you can set to optimize the performance of your data transfer:'''
 +
<br/>
 +
 
 +
* -tcp-bs <size>Specifies the size (in bytes) of the TCP buffer to be used by the underlying GridFTP data channels.
 +
* -p <number of parallel streams> Specifies the number of parallel streams to be used in the GridFTP transfer.
 +
* -stripe Use this parameter to initiate a “striped” GridFTP transfer that uses more than one node at the source and destination. As multiple nodes contribute to the transfer, each using its own network interface, a larger amount of the network bandwidth can be consumed than with a single system. Thus, at least for “big” (> 100 MB) files, striping can considerably improve performance.

A lap 2013. június 20., 15:15-kori változata

Access with GSI-SSH

A user can access to the supercomputers by using the GSI-SSH protocol.

It requires a machine with a Globus installation that provides the gsissh client.

The needed credentials (these mean the private and public keys) must be created before entering the machine with the

   grid-proxy-init

command.


To enter the site, the

   gsissh -p 2222 login.budapest.hpc.niif.hu

command has to be used.


GridFTP file transfer

In order to use GridFTP for file transfer, one needs a GridFTP client program that provides the interface between the user and a remote GridFTP server. There are several clients available for GridFTP, one of which is globus-url-copy, a command line tool which can transfer files using the GridFTP protocol as well as other protocols such as http and ftp. globus-url-copy is distributed with the Globus Toolkit and usually available on machines that have the Globus Toolkit installed.


Syntax

   globus-url-copy [options] sourceURL destinationURL

  • [options] The optional command line switches as described later.
  • sourceURL The URL of the file(s) to be copied. If it is a directory, it must end with a slash (/), and all files within that directory will be copied.
  • destURL The URL to which to copy the file(s). To copy several files to one destination URL, destURL must be a directory and be terminated with a slash (/).


Globus-url-copy supports multiple protocols, so the format of the source and destination URLs can be either

   file://path 


when you refer to a local file or directory or

   protocol://host[:port]/path


when you refer to a remote file or directory.

globus-url-copy is supporting other protocols such as http, https, ftp and gsiftp as well.


Command line options for globus-url-copy [options]

  • -help Prints usage information for the globus-url-copy program.
  • -version Prints the version of the globus-url-copy program.
  • -vb During the transfer, displays: (1) number of bytes transferred (2) performance since the last update (every 5 seconds) (3) average performance for the whole transfer


The following table lists parameters which you can set to optimize the performance of your data transfer:

  • -tcp-bs <size>Specifies the size (in bytes) of the TCP buffer to be used by the underlying GridFTP data channels.
  • -p <number of parallel streams> Specifies the number of parallel streams to be used in the GridFTP transfer.
  • -stripe Use this parameter to initiate a “striped” GridFTP transfer that uses more than one node at the source and destination. As multiple nodes contribute to the transfer, each using its own network interface, a larger amount of the network bandwidth can be consumed than with a single system. Thus, at least for “big” (> 100 MB) files, striping can considerably improve performance.