Sr Manager Data Engineer
Responsibilities
- Possesses strong rapid prototyping skills and can quickly translate concepts into working code.
- Provide expert guidance and mentorship to the data engineering team, fostering a culture of innovation and best practices.
- Design, develop, and implement robust data architectures and platforms to support business objectives.
- Oversee the development and optimization of data pipelines, and data integration solutions.
- Establish and maintain data governance policies and standards to ensure data quality, security, and compliance.
- Architect and manage cloud-based data solutions, leveraging AWS or other preferred platforms.
- Lead and motivate a high-performing data engineering team to deliver exceptional results.
- Identify, analyze, and resolve complex data-related challenges.
- Collaborate closely with business stakeholders to understand data requirements and translate them into technical solutions.
- Stay abreast of emerging data technologies and explore opportunities for innovation.
Functional Skills
Must-Have Skills
- Demonstrated proficiency in leveraging cloud platforms (AWS, Azure, GCP) for data engineering solutions. Strong understanding of cloud architecture principles and cost optimization strategies.
- Proficient on experience in Python, PySpark, SQL. Handon experience with bid data ETL performance tuning.
- Proven ability to lead and develop high-performing data engineering teams.
- Strong problem-solving, analytical, and critical thinking skills to address complex data challenges.
Good-to-Have Skills
- Experienced with data modeling and performance tuning for both OLAP and OLTP databases
- Experienced with Apache Spark, Apache Airflow
- Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and Dev Ops
- Experienced with AWS, GCP or Azure cloud services
Education and Professional Certifications
- Bachelors degree in computer science and engineering preferred, other Engineering field is considered; Masters degree and 11+ years' experience Or Bachelors degree and 12+ years' experience
- AWS Certified Data Engineer preferred
- Databricks Certificate preferred
Soft Skills
- Excellent analytical and troubleshooting skills.
- Strong verbal and written communication skills
- Ability to work effectively with global, virtual teams
- High degree of initiative and self-motivation.
- Ability to manage multiple priorities successfully.
- Team-oriented, with a focus on achieving team goals
- Strong presentation and public speaking skills.