Associate Vice President, Forward Deployed Engineer Greater London, United Kingdom Area

The Company is seeking an Associate Vice President, Forward Deployed Engineer, to build and maintain evaluation systems that ensure production AI agents are reliable, accurate, and safe. Responsibilities include creating automated evaluation suites, curating domain-specific datasets and regression testbeds, refining prompts and structured output schemas, and developing CI/CD pipelines with automated testing gates. The role also involves analyzing agent performance, implementing security controls, monitoring test cycles, and reporting diagnostics and metrics to business stakeholders. The engineer will collaborate with domain experts and delivery teams, exercise independent judgment, and help manage risks and control issues. Candidates should have relevant software engineering or systems analysis experience, with strong Python skills and practical experience using APIs, containers, and Git. Required expertise includes AI evaluation and benchmarking methods, automated testing, and CI/CD pipeline implementation. Strong communication, attention to detail, data integrity, and the ability to adapt under pressure are important. A bachelor’s degree or equivalent experience in computer science, data science, or a related quantitative field is required.

Hiring Company

Citi