Modular LLMs at scale: how FlexOlmo is helping to pool national expertise without pooling sensitive data
The Danish Foundation Models project is utilizing FlexOlmo to build modular LLMs that allow institutions to contribute specialized experts without sharing sensitive data.
By using a modular architecture, the project enables collaborative training across different organizations. This approach allows for the creation of high-quality, domain-specific models while keeping proprietary or sensitive datasets siloed and secure.