Sie befinden sich im Service: RWTH High Performance Computing (Linux)

Upload Files to the Cluster

Upload Files to the Cluster

Kurzinformation

If you would like to transfer data from your own system to our cluster, you have to use either the scp or the sftp protocol. Although data transfers are possible to or from any login node, we recommend that you use one of the systems, dedicated to the purpose of file transfers.

A single copy stream will probably achieve no more than about 80 MB/s. To get higher transfer rates you have to start several copy processes in parallel from one of the dedicated file transfer nodes.


Detailinformation

Linux Clients

You may simply use the scp or the sftp commands to copy files from Linux to our cluster. However, especially if you have to copy a large amount of data, we recommend that you use an enhanced file synchronization tool like rsync that is able to resume the file transfer in case the network connection was aborted. Example use of rsync on a Linux system:

NOTE: The name of the computer node may be outdated. Check our Data Transfer Nodes site for available nodes.

rsync -a -e ssh /home/user/data xy123456@copy23-1.hpc.itc.rwth-aachen.de:

Windows Clients

If you would like to transfer files from a Windows system to the RWTH High Performance Computing cluster, you can for example use the free WinSCP program.

First, enter you account details:

NOTE: The name of the computer node may be outdated. Check our Data Transfer Nodes site for available nodes.

WinSCP Log In

Next, copy your files by drag and drop:

WinSCP moving files

 

Using the FastX File Manager

If you use the FastX web interface to interact with the HPC Cluster, you can use the provided file manager. Mind that you should only use this for small file transfers.

For more information see the official user documentation.

 

Web Interface with HPCJupyterHub

To upload files to the cluster using the JupyterLab GUI, you can follow this method.

 

Transfering files usually requires the same connectivity capabilities of login to a normal login node.

zuletzt geändert am 13.06.2024

Wie hat Ihnen dieser Inhalt geholfen?

Creative Commons Lizenzvertrag
Dieses Werk ist lizenziert unter einer Creative Commons Namensnennung - Weitergabe unter gleichen Bedingungen 3.0 Deutschland Lizenz