You are located in service: RWTH Compute Cluster Linux (HPC)

Ansys Suite (ansys, cfx, fluent, icem)

Ansys Suite (ansys, cfx, fluent, icem)

Detailinformation 

1. Ansys

1.1 How to Access the Software

Load the ANSYS module

$ module load TECHNICS ansys
# or load specific version
$ module load ansys/20.1
 

1.2 Example Batch Script

#!/usr/local_rwth/bin/zsh
 
### Job name
#SBATCH --job-name=ANSYS_JOB
 
### File / path where STDOUT will be written, the %J is the job id
#SBATCH --output=ansys-job-log.%J
 
### Request the time you need for execution. The full format is D-HH:MM:SS
### You must at least specify minutes or days and hours and may add or
### leave out any other parameters
#SBATCH --time=80
 
### Request memory you need for your job in MB
#SBATCH --mem-per-cpu=3900
 
### Request number of hosts
#SBATCH --nodes=1
   
### Request number of CPUs
#SBATCH --ntasks=8
 
### Request all CPUs on one node
#SBATCH --nodes=1
 
### Change to the work directory
cd $HOME/jobdirectory
 
### ANSYS laden
module unload intelmpi
module load TECHNICS ansys
 
### Execute your application
### For different ansys versions, change the executable name accordingly,
### e.g. ansys195 for Ansys 19.5
### -b : Run the job in ANSYS batch mode.
### -i : ANSYS input file.
### -o : ANSYS output file:
ansys201 -b -o ansys.out -i ansys.in -mpi ibmmpi
 

1.3 Licensing

Ansys licensing information

You may use Ansys using either one of two different licenses: The Ansys Academic Teaching license and the Ansys Academic Research license. The former one may be used for free by students (bachelor/master) for educational purposes and will automatically be available when you load the software. The Academic Research license may be purchased by RWTH institutes for research purposes. Users have to be granted access to use one of these licenses by the owning institute.

Please be aware that the Teaching license is restricted in its features. For further details, please take a look at the feature set.

 

1.3.1 Changing License Preferences in Ansys

You may change the license preferences within the Ansys workbench according to your needs. This is especially important when choosing a Teaching license over an available Research license since the desired license needs to have a higher priority. To do so, start the workbench and navigate to Tools -> License Preferences... in the context menu:

Ansys Licence Preferences 1

Within the upcoming menu, use the buttons "Move up" and "Move down" to reorder the priority. The priority decreases from top to bottom. Proceed on all necessary tabs within the preference window.

Ansys Licence Preferences 2

1.3.2 Using Teaching Licenses as a Student Assistant

If you are a student assistant (Studentische/Wissenschaftliche Hilfskraft), you will be recognized as an RWTH employee on the cluster. This means that the Academic Teaching license will not be available for you on program start. To fix this, enter the following lines in your shell after loading the ansys module.

Enable Teaching Licenses as a Student Assistant
export ANSYSLMD_LICENSE_FILE=50053@license3.rz.rwth-aachen.de
export ANSYSLI_SERVERS=50055@license3.rz.rwth-aachen.de
 

1.4 Frequently Asked Questions

How can I run the Ansys Workbench?
$ module load TECHNICS ansys
$ runwb2
 

2. CFX

2.1 How to Access the Software

Load CFX module
module load TECHNICS
module load ansys
 

2.2 Example Batch Scripts

Serial Job
#!/usr/local_rwth/bin/zsh
 
### Job name
#SBATCH --job-name=CFX_SERIAL
 
### File / path where STDOUT will be written, the %J is the job id
#SBATCH --output=cfx-serial-log.%J
 
### Request the time you need for execution. The full format is D-HH:MM:SS
### You must at least specify minutes or days and hours and may add or
### leave out any other parameters
#SBATCH --time=80
 
### Request memory you need for your job in MB
#SBATCH --mem-per-cpu=3900
 
### Change to the work directory, if not here
cd $HOME/jobdirectory
 
### load modules and execute
module load TECHNICS
module load ansys
 
 
# start non-interactive batch job
cfx5solve -def job.def
 
Parallel Job (please use only in batch system; does not work interactive)
#!/usr/local_rwth/bin/zsh
 
### Job name
#SBATCH --job-name=CFX_MPI
 
### File / path where STDOUT will be written, the %J is the job id
#SBATCH --output=cfx-mpi-log.%J
 
### Request the time you need for execution. The full format is D-HH:MM:SS
### You must at least specify minutes or days and hours and may add or
### leave out any other parameters
#SBATCH --time=80
 
### Request memory you need for your job in MB
#SBATCH --mem-per-cpu=3900
 
### Request number of hosts
#SBATCH --nodes=1
   
### Request number of CPUs
#SBATCH --ntasks=8
 
### Change to the work directory
cd $HOME/jobdirectory
 
### load modules and execute
module load TECHNICS
module load ansys
 
### start non-interactive batch job
cfx5solve -def job.def -par-dist "$R_WLM_CFXHOSTLIST" -start-method "Intel MPI Distributed Parallel"
 

3. Fluent

3.1 How to Access the Software

How to load the Fluent module
module load TECHNICS
module load ansys
 

3.2 Example Batch Scripts

Serial Job
#!/usr/local_rwth/bin/zsh
 
### Job name
#SBATCH --job-name=FLUENT_SERIAL
 
### File / path where STDOUT will be written, the %J is the job id
#SBATCH --output=fluent-serial-log.%J
 
### Request the time you need for execution. The full format is D-HH:MM:SS
### You must at least specify minutes or days and hours and may add or
### leave out any other parameters
#SBATCH --time=80
 
### Request memory you need for your job in MB
#SBATCH --mem-per-cpu=3900
 
### Change to the work directory
cd $HOME/jobdirectory
 
### load modules and execute
module load TECHNICS
module load ansys
 
# start non-interactive batch job
fluent -g -platform=intel -i journalfile
 
Parallel Job - Shared Memory
#!/usr/local_rwth/bin/zsh
 
### Job name
#SBATCH --job-name=FLUENT_OMP
 
### File / path where STDOUT will be written, the %J is the job id
#SBATCH --output=fluent-omp-log.%J
 
### Request the time you need for execution. The full format is D-HH:MM:SS
### You must at least specify minutes or days and hours and may add or
### leave out any other parameters
#SBATCH --time=80
 
### Request memory you need in MB
#SBATCH --mem-per-cpu=1024
   
### Request number of CPUs=Threads
#SBATCH --cpus-per-task=8
 
### Change to the work directory
cd $HOME/jobdirectory
 
### Load modules
module load TECHNICS
module load ansys
 
# start non-interactive batch job
fluent 3d -g -pshmem -t$SLURM_NTASKS -platform=intel -i journalfile 
 
Parallel Job - Distributed Memory
#!/usr/local_rwth/bin/zsh
 
### Job name
#SBATCH --job-name=FLUENT_MPI
 
### File / path where STDOUT will be written, the %J is the job id
#SBATCH --output fluent-MPI-log.%J
 
### Request the time you need for execution. The full format is D-HH:MM:SS
### You must at least specify minutes or days and hours and may add or
### leave out any other parameters
#SBATCH --time=80
 
### Request memory you need for your job in MB
#SBATCH --mem-per-cpu=3900
   
### Request number of CPUs
#SBATCH --ntasks=8
 
### Change to the work directory
cd $HOME/jobdirectory
 
### Load modules
module load TECHNICS
module load ansys
 
### start non-interactive batch job
fluent 3ddp -g -t$SLURM_NTASKS -cnf=$R_WLM_HOSTLISTFILE -pib.infinipath -mpi=intel -i journalfile
 

3.3 Interactive usage

How to load the Fluent module
module load TECHNICS ansys
runwb2

In the Ansys Workbench:

  1. Select the "Component Toolbox"
  2. Add the "Fluent" Toolbox
  3. Run "Setup"
  4. Select the "Processing Option" "Parallel"
    (+ "Show more options")
    (Tab "Parallel Settings")
  5. Choose "infiniband" as "Interconnects"
  6. Choose "openmpi" as "MPI types"

fluent 1

fluent 2

 

4. ICEM

4.1 How to Access the Software

How to load the ICEM module
module load TECHNICS
module load icem
 

4.2 Example Batch Script

#!/usr/local_rwth/bin/zsh
  
### Job name
#SBATCH --job-name=ICEM_SERIAL
  
### File / path where STDOUT will be written, the %J is the job id
#SBATCH --output=icem-serial-log.%J
  
### Request the time you need for execution. The full format is D-HH:MM:SS
### You must at least specify minutes or days and hours and may add or
### leave out any other parameters
#SBATCH --time=80
  
### Request memory you need for your job in MB
#SBATCH --mem-per-cpu=3900
  
### Export an environment var - do you need that?
export A_ENV_VAR=10
  
### Change to the work directory
cd $HOME/workdirectory
  
### load modules and execute
module load TECHNICS
module load ansys
  
# start non-interactive batch job
icemcfd -batch -script icem.script
  
# You need a file containing information for net generation, e. g.
# an icem.skript containing the following line
#
# ic_run_tetra "Job.tin" "tetra_mesh.uns"
 

5. Known limitations

5.1 MPI vendors

Ansys is delivered with support for different MPI vendors: IBM-MPI (previously known as HP-MPI), Open MPI, Intel MPI, each in varying versions, sometimes more than one, but mostly older versions. As we have an Intel OmniPath fabric in our clusters we focus on Intel MPI. We do not support IBMMPI and OpenMPI (but do not rule out the possibility that these could work on some circumstandes)

As some older versions of Intel MPI used in older versions of Ansys do need additinal tuning to run (with good performance) on OPA fabric, we moved these older versions of Ansys to DEPRECATED area even if we know how-to tweak these; please use actual versions of Ansys

In terms of performance, a single-node job is (almost) always faster than the same amount of ranks spread across multiple nodes due to the fact that a fabric is always slower than intra-node communication. Try to stay on a single node whenever possible.

last changed on 10.02.2021

How did this content help you?