Skip to main content Skip to main navigation

Project | OpenGPT-X

Duration:
Aufbau eines Gaia-X Knotens für große Kl-Sprachmodelle und innovative Sprachapplikations-Services; Teilvorhaben: Entwicklung von Sprachmodellen, Interoperabilitäts- und Nutzungskonzepten

Aufbau eines Gaia-X Knotens für große Kl-Sprachmodelle und innovative Sprachapplikations-Services; Teilvorhaben: Entwicklung von Sprachmodellen, Interoperabilitäts- und Nutzungskonzepten

Generative AI (GenAI) and Large Language Models (LLMs) have been making headlines since ChatGPT and have great potential for enterprise use. However, most of the most powerful models today are “closed source”, developed by large US and Chinese companies. OpenGPT-X aims to set an example: Given the right conditions, Germany and Europe can keep pace internationally in the development of this key technology – while emphasising their own unique selling points. The project aims to strengthen freedom of choice and digital sovereignty for German companies in the field of GenAI, removing existing barriers to the use of generative AI.

OpenGPT-X and its consortium partners represent the entire GenAI value chain: From the highly scalable, GPU-based infrastructure and data for training large language models, to the design of the models themselves, to the productive application in the form of prototypes and proofs of concepts (PoCs) by consortium partners from industry. On the one hand, the project aims at advancing cutting-edge research questions and conducting scientific studies on critical decisions for training the models. On the other hand, the productive use of the models is considered from the very first development step.

The project is funded by the German Federal Ministry for Economic Affairs and Climate Action (BMWK) as part of the funding competition “Innovative and practical applications and data spaces in the Gaia-X digital ecosystem” from January 2022 to March 2025. The total funding amounts to about 14 million Euros. The Bundesnetzagentur (BNetzA) is responsible for the implementation of the Gaia-X funding competition. The Gaia-X Hub Germany at acatech – National Academy of Science and Engineering supports the Gaia-X funding projects in terms of scientific monitoring, networking and transfer of results.

Publications

All publications
  1. Occiglot at WMT24: European open-source large language models evaluated on translation

    Eleftherios Avramidis; Annika Grützner-Zahn; Manuel Brack; Patrick Schramowski; Pedro Ortiz Suarez; Malte Ostendorff; Fabio Barth; Shushen Manakhimova; Vivien Macketanz; Georg Rehm; Kristian Kersting

    In: Philipp Koehn; Barry Haddow; Tom Kocmi; Christof Monz (Hrsg.). Proceedings of the Ninth Conference on Machine Translation. Conference on Machine Translation (WMT-24), located at EMNLP 2024, November 15-16, Miami, Florida, USA, Association for Computational Linguistics, 11/2024.
  2. Large Language Models are Echo Chambers

    Jan Nehring; Aleksandra Gabryszak; Pascal Jürgens; Aljoscha Burchardt; Stefan Schaffer; Matthias Spielkamp; Birgit Stark

    In: Nicoletta Calzolari; Min-Yen Kan; Veronique Hoste; Alessandro Lenci; Sakriani Sakti; Nianwen Xue (Hrsg.). Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024). Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING-2024), ELRA and ICCL, 2024.

Funding Authorities

BMWi - Federal Ministry for Economic Affairs and Energy

68GX21007D

BMWi - Federal Ministry for Economic Affairs and Energy