Lead Solution Designer - Data & Analytics
About the role
The position plays a pivotal role within our evolving Data Engineering team, leading the strategic implementation of data solutions on AWS. You will be responsible for driving the technical vision and execution of cloud-based data architectures, ensuring the platform's scalability, security, and performance while addressing both business and technical requirements. This role demands a hands-on leader role with deep technical expertise who can also steer strategic initiatives to success.
Key responsibilities
Spearhead the implementation, performance fine-tuning, development, and delivery of data solutions using AWS core data services, driving innovation in Data Engineering, Governance and Integration.
Oversee all technical aspects of AWS-based data systems, ensuring end-to-end delivery.
Coordinate with multiple stakeholders to ensure timely implementation and effective value realization.
Continuously enhance the D&A platform to improve performance, resiliency, scalability, and security while incorporating new data technologies and methodologies.
Work closely with business partners, data architects, and cross-functional teams to translate complex business requirements into technical solutions.
Develop and implement data management strategies, including Data Lakehouse, Data Warehousing, Master Data Management, and Advanced Analytics solutions.
Combine technical solutioning with hands-on work as needed, actively contributing to the architecture, coding, and deployment of critical data systems.
Ensure system health by monitoring platform performance, identifying potential issues, and taking preventive or corrective measures as needed.
Be accountable for the accuracy, consistency, and overall quality of the data used in various applications and analytical processes.
Advocate for the use of best practices in data engineering, governance, and AWS cloud technologies, advising on the latest tools and standards.
About you
10+ years of hands-on experience in data engineering, solution design, and enterprise data architecture with deep AWS expertise and demonstrated leadership in large-scale data initiatives.
Proven experience designing and implementing AWS data services (such as S3, Redshift, Athena, Glue, Lambda, etc.) and a solid understanding of data service design patterns.
Expertise in building large-scale data platforms, including Data Lakehouse, Data Warehouse, Master Data Management, and Advanced Analytics systems.
Ability to effectively communicate complex technical solutions to both technical and non-technical stakeholders.
Experience working with multi-disciplinary teams and aligning data strategies with business objectives.
Demonstrated expertise and hands-on proficiency in PySpark for designing, building, and optimizing large-scale batch and streaming data pipelines on AWS.
Proficiency in workflow orchestration platforms for designing the scheduling, monitoring, and managing complex data pipelines and dependencies.
Ability to optimize cloud costs and resource utilization in large-scale data environments without compromising performance.
Proficiency in CI/CD-driven deployment and management of AWS data infrastructure.
Lead, mentor, and develop data engineering teams, fostering technical excellence, knowledge sharing, and career growth within the organization.