We are providing HCP Tools as a high-speed file transfer tool.
HCP Tools uses the HpFP protocol, which enables fast file transfer. HCP Tools can be used by installing the dedicated package.
・When using Windows as a client： ~/_hcp/id_rsa ・When using Linux as a client： ~/.hcp/id_rsa
The private key storage location can be changed in the configuration file. Please refer to the reference manual for details.
This section explains how to log in to the Supercomputer Systems using the hcp command. The hcp command uses the command prompt (terminal).
Upload : hcp [OPTION]... SOURCE [SOURCE]... [USER@]HOST[:PORT]:DEST Download : hcp [OPTION]... [USER@]HOST[:PORT]:SOURCE [:SOURCE]... DEST
|Short options||Long options||Purposes|
|-p||--permission||Preserve information about file permissions of the transfer source|
|-R||--recursive||Copy all files under each directory, recursively|
|--hpfp||Using HpFP protocol.|
|--user=<username>||Specifying user name.|
|--mcd=<number>||Specifying a mcd for connections.|
In the following examples, user ID will be “b59999.”
Please open a command prompt (terminal) on your PC to perform the following operations.
$ hcp file1.txt hpcfs.kudpc.kyoto-u.ac.jp:~/ Login as: ←Entering your user ID. Passphrase for the key: ←Entering your passphrase.
$ hcp --user=b59999 file1.txt hpcfs.kudpc.kyoto-u.ac.jp:~/ Passphrase for the key: ←Entering your passphrase. or $ hcp file1.txt email@example.com:~/ Passphrase for the key: ←Entering your passphrase.
$ hcp hpcfs.kudpc.kyoto-u.ac.jp:file1.dat file2.dat Login as: ←Entering your user ID. Passphrase for the key: ←Entering your passphrase.
$ hcp -R dir1 hpcfs.kudpc.kyoto-u.ac.jp:~/ Login as: ←Entering your user ID. Passphrase for the key: ←Entering your passphrase.
$ hcp --hpfp file1.txt hpcfs.kudpc.kyoto-u.ac.jp:~/ Login as: ←Entering your user ID. Passphrase for the key: ←Entering your passphrase.
$ Specifying a number of multiple connections, and making a copy of “file1.txt” to a remote machine. hcp --mcd=1 file1.txt hpcfs.kudpc.kyoto-u.ac.jp:~/ Login as: ←Entering your user ID. Passphrase for the key: ←Entering your passphrase.
※The mcd (number of multiple connections) is set to 8 by default.
See the --help option or the command reference for detailed options and descriptions of options for other commands (hcp-ls, hmv, etc.).
2022/02/10 10:45:49 0000498c:INFO :Authentication failed. 2022/02/10 10:45:49 0000498c:INFO :Authentication was failed in building a point.hcp::node:HcpnException @ hcp::node::HcpnEndPointTransfer:L454 : > hcp::proto::HcppException @ hcp::proto::HcppSession:L1214 :
Make sure that the key or passphrase is correct.
2022/01/06 16:30:22 00007fc882ffd700:INFO :CH[6, primary=0] negotiate failed. 2022/01/06 16:30:22 00007fc882ffd700:INFO :hcp::proto::HcppException @ hcp::proto::HcppSessionSecondaryChannel:L1148 : No welcome message from the server was received. The server might refuse your request to connect subject to its admission control or access control list.
The connection that has been successfully negotiated will be used for communication. Please wait until communication is completed.
2022/01/12 13:50:12 00007f9c175c8700:INFO :A signal message was received from the remote host. The session will abort in a reason specified by the message (reason=0xBFFB). 2022/01/12 13:50:12 00007f9c15dc5700:INFO :Could not offer a request @ hcp::proto::HcppSessionInitiator_:L172.
Make sure that the path to the directory is correct.
2022/01/12 17:18:22 00002930:INFO :Your requested congestion mode of HpFP will not be used (requested=AGGRESSIVE, actual=FAIR).
Connect in FAIR mode.
HpFP is a UDP-based protocol. In an environment where latency and packet loss are occurring, using HpFP (--hpfp option) is expected to speed up the process.
When HpFP (--hpfp option) is not used, TCP is used for the connection. Because of session multiplexing, it is slightly faster than scp or sftp.
Communicating with the WebSocket protocol is not allowed.
For communication with HCP tools, use 874/tcp and 65520/udp (when the --hpfp option is used).
Depending on your environment, the port may not be open. In that case, communication is not possible.
For fair use of the file transfer server, the number of server connections per user is limited to 8. By default, the number of connections to the server used for file transfer is set to "8" to speed up file transfer, and multiple hcp commands cannot be executed simultaneously.To execute multiple hcp commands simultaneously, the number of connections must be specified using the --mcd option.
The congestion control mode allows only FAIR.
If you specify a mode other than FAIR, a message "When you specify a congestion control mode that is not allowed" is displayed and the connection is made with FAIR.
In HCP tools version 1.3.0R2_49 or later, which is currently available, the functionality has been enhanced to apply auxiliary groups to determine file access permissions. This makes it possible to transfer files on a large volume disk (LARGE) without being aware of the default group at login.