The Company is seeking a Quality Assurance Engineer with a focus on AI agentic applications. The successful candidate will be responsible for validating these applications across development and production, with a strong emphasis on specialized AI testing, automation, safety evaluation, and continuous quality measurement. Key responsibilities include designing, building, and executing test strategies for various AI components, such as LLM accuracy, RAG ingestion and attribution, agent planning, and tool use. The role also involves establishing quantitative AI evaluation metrics, building and maintaining automated test suites, and analyzing production AI interactions to identify and address failure patterns. Applicants must have a Bachelor's degree or above in a relevant technical discipline, at least 5 years' of experience in software quality assurance and testing, and a minimum of 1-2 years' of hands-on experience specifically in testing GenAI, LLM, or agentic AI applications. Strong programming skills in Java, Kotlin, or Python, as well as a deep understanding of generative AI technologies, are essential. Experience with AI testing tools and frameworks, as well as a background in the financial services industry, is a plus. The ideal candidate will have a proven ability to leverage AI tools for testing and be adept at applying critical judgment to ensure the responsible and ethical use of data and AI outputs.

Hiring Company

Deutsche Bank