Principal Data Engineer
Posted Updated
Role Overview
Responsibilities
Functional Skills
Good-to-Have Skills
Education and Professional Certifications
Soft Skills
We are seeking a seasoned Principal Data Engineer to lead the design, development, and implementation of our data strategy. The ideal candidate possesses a deep understanding of data engineering principles, coupled with strong leadership and problem-solving skills. As a Principal Data Engineer, you will architect and oversee the development of robust data platforms, while mentoring and guiding a team of data engineers.
Responsibilities
- Possesses strong rapid prototyping skills and can quickly translate concepts into working code.
- Provide expert guidance and mentorship to the data engineering team, fostering a culture of innovation and best practices.
- Design, develop, and implement robust data architectures and platforms to support business objectives.
- Oversee the development and optimization of data pipelines, and data integration solutions.
- Establish and maintain data governance policies and standards to ensure data quality, security, and compliance.
- Architect and manage cloud-based data solutions, leveraging AWS or other preferred platforms.
- Lead and motivate a high-performing data engineering team to deliver exceptional results.
- Identify, analyze, and resolve complex data-related challenges.
- Collaborate closely with business stakeholders to understand data requirements and translate them into technical solutions.
- Stay abreast of emerging data technologies and explore opportunities for innovation.
Functional Skills
- Demonstrated proficiency in leveraging cloud platforms (AWS, Azure, GCP) for data engineering solutions. Strong understanding of cloud architecture principles and cost optimization strategies.
- Proficient in Python, PySpark, SQL. Hands-on experience with big data ETL performance tuning.
- Proven ability to lead and develop high-performing data engineering teams.
- Strong problem-solving, analytical, and critical thinking skills to address complex data challenges.
Good-to-Have Skills
- Experienced with data modeling and performance tuning for both OLAP and OLTP databases
- Experienced with Apache Spark, Apache Airflow
- Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and Dev Ops
- Experienced with AWS, GCP or Azure cloud services
Education and Professional Certifications
- Bachelors degree and 12 to 17years' experience
- AWS Certified Data Engineer preferred
- DatabricksCertificate preferred
Soft Skills
- Excellent analytical and troubleshooting skills.
- Strong verbal and written communication skills
- Ability to work effectively with global, virtual teams
- High degree of initiative and self-motivation.
- Ability to manage multiple priorities successfully.
- Team-oriented, with a focus on achieving team goals
- Strong presentation and public speaking skills.