Research Lead, Evaluations

Black Forest Labs - Freiburg (Germany) - Global - IT & Technology

About Black Forest Labs

We’re the team building the foundational layer for visual intelligence: multimodal models trained jointly on images, video, audio, and action to see, generate, and understand the world.

Our founding team pioneered latent diffusion and Stable Diffusion, the breakthroughs that made generative AI accessible to millions. With FLUX, we're pushing into generative media at scale, machines that act in the physical world, and emerging applications in computer use.

Our FLUX models top public benchmarks and run in production in some of the world's biggest platforms. We're a small, fast growing research lab competing with the largest companies in the world. From our labs in Freiburg to San Francisco, we're building what comes next.

Why This Role

BFL’s research organization is split into different focus areas, such as pre-training, post-training, reinforcement learning, data, representation learning, evaluations and more. During the day to day work, researchers from these different focus areas work together to solve exciting and hard problems towards solving visual intelligence.

Having the right means to measure what matters is the central starting point for every research project. Researchers make decisions based on the outcomes of evaluations. The right decision can only be made if an evaluation is precise and accurate. As the Evaluations Lead you’re the core driver to ensure that. Central responsibilities include building our eval roadmap in collaboration with the research and product teams, managing and extending our evaluation team, and cross-functional work with project leads to make sure each research project has the best evaluation toolbox to help the people working on it to make the right decisions. Finally, you’re responsible for growing the people in your team and maintain an eye on their long term development during the daily project work.

What You’ll Work On

  • Defining what we evaluate: You are the core driver to create, maintain and extend our evaluations roadmap by collaborating with the product and other research leads who provide the required input.

  • Defining how we evaluate: You’ll work with the team to implement our evals roadmap. This includes building new evals. Both benchmarks and the necessary objective functions, involving both automated, AI-based, and human evaluations.

  • Minimizing noise in our

Browse more GCC jobs on EzWorkers