You are located in service: RWTH High Performance Computing (Linux)

Additional Information

Additional Information

This page contains some additional information about the file system that did not fit anywhere else. It is still adviced to consider the following topics carefully.

Table of Contents


Visibility of Filesystem

Each user directory is only mounted when a process actually accesses it. Therefore, you might not see a specific user directory in a listing of /home, /work or /hpcwork (which can be confusing, especially if you are using a graphical file manager). This does not mean that a user directory does not exist, but that you might have to type the path to a user directory explicitly to actually get there. Any action that causes an access to your directory will mount it and thereby make it visible. This can be done by changing into the directory in a terminal or typing the full path of your directory in the address bar of your file manager.

Backup Exclusion

The following files and directories are currently excluded from the backup in $HOME:

  • Complete sub-directories: 
    • .NOBACKUP
    • ~/.cache
    • ~/.comsol/*/configuration
    • ~/.Trash*
    • ~/.local/share/Trash*
  • File patterns:
    • core.*.rz.RWTH-Aachen.DE.[1-9]*.[1-9]*
    • core.*.hpc.itc.rwth-aachen.de.[1-9]*.[1-9]*
Snapshots

Snapshots reflect the state of a file system at previous points in time. By changing to a snapshot directory, ($HOME_SNAPSHOT or $WORK_SNAPSHOT), you can access previous versions of your files. The files within the snapshots are read-only, they can not be altered or deleted. Please note that the snapshots creation policy is subject to change. If space gets short, we may decide to create less snapshots, delete existing snapshots or omit them completely. Snapshots are not an alternative to a backup. If a file system gets damaged, all snapshots are lost, too.

$TMP

In case you are using a sinlge node exclusively and would like to use the local SSD, BeeOND can cause some unneccessary overhead. In this case you can directly access the SSD via the path stored in $TMP.

We do not reccomend using the local SSD storage on shared nodes, as there are no restrictions on how much space each user can occupy. It is therefore unpredictable if storage space on the local SSD is available.

Broken Files on HPCWORK

In your $HPCWORK directory you may sometimes encounter files for which the command ls -l reports an error "No such file or directory" and displays something like

-????????? ? ?        ?               ?            ? FILENAME

The reason is usually that parts of the file are lost, for example due to a crash of one of the HPCWORK file servers. Since there is no backup of $HPCWORK, we are not able to restore the content of such files. You can try to recover those parts of the file that are still readable with the command

dd_rescue -e 10240 -b 1M -B 1M <BROKEN_FILE> <RECOVERED_FILE>

In order to remove a broken file you might have to use the following command - rm will usually not work:

unlink <BROKEN_FILE>

last changed on 05/31/2024

How did this content help you?

Creative Commons Lizenzvertrag
This work is licensed under a Creative Commons Attribution - Share Alike 3.0 Germany License