Data Engineering - Assistant Vice President
Description
About the Role
We are seeking an experienced Assistant Vice President (AVP) - Data Engineering to lead the design and delivery of scalable, governed, and high-performing data solutions for finance operations, reporting, and analytics. The role requires deep hands-on expertise in data engineering, strong solution architecture and delivery leadership, and the ability to translate complex business requirements into reliable data products. Data science, machine learning, and generative AI exposure will be considered complementary skills rather than the primary focus of the position.
Key Responsibilities
· Lead the architecture, design, development, and production support of enterprise-grade batch and near-real-time data pipelines across structured and semi-structured data sources.
· Design scalable ETL/ELT frameworks using Python, SQL, Alteryx and modern cloud data engineering services, with reusable components, standards, monitoring, and exception handling.
· Own dimensional and relational data models, data marts, semantic-ready datasets, metadata, lineage, and documentation supporting regulatory, operational, and management reporting.
· Drive query, pipeline, and storage performance optimization for large-volume datasets, including partitioning, indexing, incremental loads, parallel processing, and workload management.
· Establish controls for data quality, reconciliation, auditability, security, retention, and access management in partnership with data governance, risk, and technology teams.
· Provide technical leadership through design reviews, code reviews, development standards, release governance, incident resolution, root-cause analysis, and continuous improvement.
· Partner with business, reporting, analytics, architecture, infrastructure, and vendor teams to define roadmaps, estimate delivery, manage dependencies, and deliver measurable outcomes.
· Mentor engineers and analysts, build team capability, and communicate solution options, risks, and trade-offs clearly to senior stakeholders.
· Evaluate data science, ML, and AI use cases where they can improve data quality, anomaly detection, forecasting, classification, or operational efficiency.
Must-Have Skills and Experience
· 12-16 years of relevant technology experience, including substantial hands-on data engineering experience and at least 3 years leading complex data solutions or engineering workstreams.
· Advanced SQL skills covering complex joins, window functions, stored procedures, query plans, indexing, performance tuning, and large-scale data transformations.
· Strong Python engineering skills for data processing, automation, API integration, reusable libraries, testing, logging, and production-quality pipeline development.
· Demonstrated experience designing ETL/ELT pipelines, orchestration, scheduling, restartability, dependency management, monitoring, and production support.
· Strong knowledge of data modeling, relational databases, dimensional modeling, schema design, slowly changing dimensions, data marts, and master/reference data patterns.
· Hands-on experience with Alteryx and at least one modern engineering stack such as Azure Data Factory, Microsoft Fabric, Azure Synapse, Databricks, Apache Spark, AWS Glue, or equivalent.
· Experience working with APIs, JSON, CSV, Parquet, database extracts, file-based feeds, structured/semi-structured data, and secure data transfer patterns.
· Practical experience with Git-based version control, CI/CD, unit and integration testing, environment promotion, release management, and technical documentation.
· Strong understanding of data quality controls, reconciliation, lineage, metadata, security, privacy, audit controls, and regulated data-management practices.
· Proven leadership, stakeholder management, problem-solving, written communication, and ability to manage competing priorities in a global delivery environment.
Good-to-Know / Secondary Skills
· Working knowledge of data science methods such as exploratory data analysis, feature engineering, statistical testing, time-series analysis, clustering, classification, and model evaluation.
· Familiarity with machine learning libraries such as scikit-learn, TensorFlow, or PyTorch and the ability to operationalize model inputs and outputs through governed data pipelines.
· Awareness of generative AI concepts including large language models, prompt design, embeddings, vector databases, retrieval-augmented generation, and responsible AI controls.
· Exposure to MLOps or LLMOps practices including model/version tracking, deployment, monitoring, drift detection, evaluation, and model risk governance.
· Experience with Power BI, DAX, semantic models, or similar business intelligence platforms, particularly in preparing reliable and performant datasets for reporting.
· Familiarity with Docker, Kubernetes, graph databases, event-streaming technologies such as Kafka, and infrastructure-as-code is advantageous.
· Financial-services experience, especially in banking operations, payments, transaction management, reconciliation, controls, or regulatory reporting, is preferred.
Education and Professional Attributes
· Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, Data Science, Statistics, or a related discipline.
· Cloud or data-engineering certifications from Microsoft Azure, Databricks, AWS, Google Cloud, or equivalent are advantageous.
· Ability to balance strategic architecture with hands-on delivery, maintain strong control discipline, and build trusted partnerships across business and technology teams.
About State Street
Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.
We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.
As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.
Discover more information on jobs at
Read our CEO Statement
Skills
- AI
- Alteryx
- Analytics
- Anomaly Detection
- API
- Automation
- AWS
- Aws Glue
- Azure
- Azure Data Factory
- Azure Synapse
- Business Intelligence
- CI/CD
- Cloud
- Data Engineering
- Data Governance
- Data Modeling
- Data Pipelines
- Data Quality
- Data Science
- Databricks
- Dimensional Modeling
- Docker
- ELT
- Embeddings
- ETL
- Feature Engineering
- GCP
- Generative AI
- Git
- Infrastructure as Code
- Integration Testing
- JSON
- Kafka
- Kubernetes
- LLM
- LLMOps
- Machine Learning
- Microsoft Fabric
- MLOps
- Model Evaluation
- Parquet
- Power BI
- Python
- PyTorch
- RAG
- RDBMS
- Root Cause Analysis
- scikit-learn
- Spark
- SQL
- Stakeholder Management
- Statistics
- TensorFlow
- Time Series
- Vector Databases
- Version Control
Sign in to read and join the discussion.