Accessing LLMs
This page describes how you can access LLMs.
Access for API usage
As part of the German AI Service Center WestAI, RWTH Aachen University offers access to self-hosted open-weight language models (LLMs). These models are also available to NRW universities via Inferenz NRW.
Access depends on whether you are a member of an NRW university with access to KI:connect.nrw, such as RWTH Aachen University.
API access for NRW universities via KI:connect
If your university provides members with access to KI:connect, you can generate an API key directly in the KI:connect interface. To create an API key:
- Log in to your KI:connect tenant with your institutional Single Sign-On (SSO).
- After the successful login, left-click your username in the bottom left corner.
- Open API Keys Management and select Generate Key.
- Save the key immediately; it cannot be retrieved later.
To view available models in KI:connect:
- Open the menu at the top and select Learn more.
- Models labeled Processing exclusively in Germany are hosted via Inferenz NRW and WestAI.
KI:connect API keys provide access through an OpenAI-compatible interface and currently support:
- Embeddings
- Chat completions
The main API endpoint, which is also disclosed in the menu for creating an API key, is:
Requesting API access via WestAI
If you are not affiliated with an NRW university that provides access to KI:connect, you can request access through WestAI.
Please click on the following email link, fill out the email form and send your request to contact@westai.de. Please include:
- Your institution or affiliation.
- A short description of intended usage.
- Confirmation that this access is for exploratory research and prototyping, not a commercial product.
- Further: Use the subject line Request for Access to LLMs at RWTH Aachen University.
Requests are reviewed, and an API key is issued by email if approved.
With a WestAI API key, our models are accessible through an OpenAI-compatible API Endpoint at:
Access to Graphical User Interfaces (GUI)
During our current beta phase, access to graphical interfaces is subject to the following conditions and limitations:
- Members of RWTH Aachen University or NRW universities with KI:connect access can use KI:connect UI and select one of the self-hosted models for chatting.
- External users may request access to the LLM-Lab hosted by Fraunhofer. This platform provides a browser-based interface for evaluating and comparing a selection of self-hosted models.
- You may also use local GUI applications that support API-based access, such as Open WebUI (our recommended option), AnythingLLM, or Jan.
For installation and configuration instructions, see the step-by-step Open WebUI Docker Desktop guide
