Assistant Vice President, AI Systems Design Architect Greater Boston, MA Area

The Company is seeking an Assistant Vice President, AI Systems Design Architect to own end-to-end architecture for an enterprise AI platform and shared AI services. The role translates business and platform needs into secure, scalable, resilient technical designs, defining reference architectures, integration contracts, and non-functional requirements. Responsibilities include designing model integration, orchestration, APIs, data flows, and reusable patterns for retrieval-augmented generation, model serving, and agentic workflows. The architect will collaborate across product, engineering, data science, cloud, and security teams; conduct design reviews and proof-of-concept assessments; and support production readiness, monitoring, and scalability. The role also ensures alignment with responsible AI, governance, compliance, risk, testing, and operational controls. Candidates should have a bachelor’s degree in computer science, information systems, engineering, mathematics, or a related field; a master’s degree is preferred. Applicants need 8–14 years of experience in solution, enterprise, platform, or AI/ML architecture, with hands-on expertise in generative AI, large language models, machine learning, RAG, vector databases, and AI application integration. Strong cloud architecture experience with at least one major cloud platform is required, along with knowledge of cloud-native services, APIs, microservices, distributed systems, event-driven architecture, and system integration. Candidates should understand security, resilience, scalability, observability, performance, AI governance, and model risk, and be able to communicate complex technical concepts while leading architecture discussions and collaborating effectively with stakeholders.

Hiring Company

State Street