Lead Data Integration Engineer
We are seeking a Lead Data Integration Engineer to build and optimize data pipelines within the AWS ecosystem, enabling seamless integration and robust data reporting for critical decision-making processes.
Responsibilities
- Collaborate with business analysts to understand and implement data requirements
- Design and develop efficient data pipelines using AWS technologies
- Ensure reliability, performance, and scalability of data pipelines
- Troubleshoot and resolve data integration issues promptly
- Implement data mappings, aggregations, and quality checks based on business analyst input
- Maintain clear and comprehensive documentation of integration processes
- Support data asset transition processes using Iceberg
- Facilitate data querying and manipulation with SQL
- Leverage tools like DBT and Airflow for pipeline orchestration and data modeling
- Align data integration processes with compliance standards and best practices
Requirements
- 5+ years of proven experience in data integration and data warehousing
- Proficiency in DBT, Airflow, and SQL for data transformation, orchestration, and querying
- Skills in Python for API development and automation
- Expertise in Iceberg for data asset management and transition
- Knowledge of Snowflake and Power BI for data warehousing and visualization
- Demonstrated ability in data modeling and database performance tuning
- Familiarity with implementing data quality checks and aggregation processes
- Strong problem-solving, analytical, and communication skills
- Effective use of data integration tools in cloud-based environments (AWS)
Benefits
With us you can:
- Work on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in Ukraine
- Receive the necessary equipment to perform your work tasks
- Change projects and technology stacks within EPAM
- Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)
- Relocation opportunities may be available for eligible candidates, depending on the role and openings at other EPAM locations
- Participate in volunteer, charity programs and communities (both technical and interest-based)
We focus on your professional growth:
- You can plan your individual career path together with your manager
- Receive regular feedback from colleagues
- Improve your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)
- Get the opportunity to undergo free training and certification in AWS, GCP, or Azure Clouds
- Use the internal E-learn training program (18,200+ specialized training and mentoring programs)
- Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resources
- Study at EPAM Solution Architecture School with the instructors who are practicing architects
- Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and more
- Participate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)
What we offer:
- Vacation and sick leave (including a sick leave without a medical certificate)
- A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)
- Medical insurance for family members at corporate rates
- Company support during significant life events (childbirth or adoption, marriage, etc.)
- Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic training
- E-kids program - a free programming language training program for EPAMers' children