Vice President, Senior Databricks Data Engineer Greater Boston, MA Area + 1 more

The Company is seeking a Senior Databricks Data Engineer with a VP level of experience to join their dynamic team. The successful candidate will be a key player in the design, development, and maintenance of end-to-end data pipelines, with a focus on data ingestion, transformation, and loading into data lakes. This role demands a hands-on approach, including the development of custom frameworks and libraries, and the ability to work within an agile scrum team. The ideal candidate will have a strong background in application architecture, a deep understanding of leading IT technologies, and extensive experience in micro-services architecture and cloud computing, particularly with Azure. As a Senior Databricks Data Engineer, the role involves working extensively with Databricks, Delta Lake, and Apache Spark, and requires proficiency in Databricks SQL and Scala. The candidate should be adept at monitoring and troubleshooting data pipelines, implementing data quality checks, and have a proven track record in DevOps pipeline troubleshooting. Experience in the financial industry and with agile development methodology is essential. The position also values strong communication, problem-solving, and critical-thinking skills, as well as the ability to drive change through collaboration and influence. A Bachelor's degree in a computer or IT-related field, along with a minimum of 10 years' of Big Data data pipeline experience, is required.

Hiring Company

State Street