
You are located in service:LLM Hosting
LLM Hosting
Important
On our HPC infrastructure, we host multiple stand-alone Open Weight Large Language Models (LLMs). Access to these models is available through both an API and a web interface, providing a data-sovereign alternative to commercial providers such as OpenAI/ChatGPT and Meta.
This service enables users to process sensitive data securely, with our IT Center ensuring compliance with data protection regulations. We prioritize privacy by not storing any data or prompt content made during usage or within requests.
Who is allowed to use LLMs?
Members of RWTH Aachen University can use the LLMs. Other users need to request access separately.
How can one access the LLMs?
You can access LLMs either via the web interface or via the API.
Quota Limitations
At the moment, we have not established any limits on requests or tokens in order to better evaluate demand and utilization.
However, should we encounter bottlenecks or an increase in demand or user activity, we reserve the right to set appropriate limits.