Head of Evaluations

The Company is seeking a Head of Evaluations to lead a team that focuses on both capability and safety evaluations of its foundation models. The successful candidate will be responsible for running the evaluation program, which is a critical part of the research and development process. This role involves direct line management of a team of around 12 researchers and engineers, with plans to expand the team in the near future. The Head of Evaluations will also be the primary point of contact for the company's engagement with AI Safety Institutes in the UK and US. The position is pivotal in ensuring the quality and safety of the company's models, and the role is highly visible both internally and externally, with a strong emphasis on publication and research credibility. Applicants for the Head of Evaluations position at the company should currently hold a similar leadership role in a peer frontier lab, foundation lab, or AI Safety Institute. The ideal candidate will have a strong background in both engineering-led and research-led evaluation disciplines, and be comfortable with the dual remit of the role. Publication credibility is essential, as the Head of Evaluations is expected to be a named author in the company's evaluation research. The role requires a strategic thinker who can manage a diverse team and is adept at working at the intersection of capability and safety evaluations. The Head of Evaluations will be part of a dynamic, research-dense environment and is expected to contribute to the company's mission of building general-purpose foundation models.