Accessing LLMs
This page describes how you can access LLMs.
Access for API usage
As part of the German AI Service Center WestAI (wird in neuem Tab geöffnet), RWTH Aachen University offers access to self-hosted open-weight language models (LLMs). These models are also available to NRW universities via Inferenz NRW (wird in neuem Tab geöffnet).
Access depends on whether you are a member of an NRW university with access to KI:connect.nrw (wird in neuem Tab geöffnet), such as RWTH Aachen University.
API access for NRW universities via KI:connect
If your university provides members with access to KI:connect, you can generate an API key directly in the KI:connect interface. To create an API key:
- Log in to your KI:connect tenant (wird in neuem Tab geöffnet) with your institutional Single Sign-On (SSO).
- After the successful login, left-click your username in the bottom left corner.
- Open API Keys Management and select Generate Key.
- Save the key immediately; it cannot be retrieved later.
To view available models in KI:connect:
- Open the menu at the top and select Learn more.
- Models labeled Processing exclusively in Germany are hosted via Inferenz NRW and WestAI.
KI:connect API keys provide access through an OpenAI-compatible interface and currently support:
- Embeddings
- Chat completions
The main API endpoint, which is also disclosed in the menu for creating an API key, is:
Requesting API access via WestAI
If you are not affiliated with an NRW university that provides access to KI:connect, you can request access through WestAI.
Please click on the following email link, fill out the email form and send your request to (E-Mail schreiben an:) contact@westai.de. Please include:
- Your institution or affiliation.
- A short description of intended usage.
- Confirmation that this access is for exploratory research and prototyping, not a commercial product.
- Further: Use the subject line Request for Access to LLMs at RWTH Aachen University.
Requests are reviewed, and an API key is issued by email if approved.
With a WestAI API key, our models are accessible through an OpenAI-compatible API Endpoint at:
Access to Graphical User Interfaces (GUI)
During our current beta phase, access to graphical interfaces is subject to the following conditions and limitations:
- Members of RWTH Aachen University or NRW universities with KI:connect access can use KI:connect UI (wird in neuem Tab geöffnet) and select one of the self-hosted models for chatting.
- External users may request access to the LLM-Lab (wird in neuem Tab geöffnet) hosted by Fraunhofer. This platform provides a browser-based interface for evaluating and comparing a selection of self-hosted models.
- You may also use local GUI applications that support API-based access, such as Open WebUI (wird in neuem Tab geöffnet) (our recommended option), AnythingLLM (wird in neuem Tab geöffnet), or Jan (wird in neuem Tab geöffnet).
For installation and configuration instructions, see the step-by-step Open WebUI Docker Desktop guide
