Senior Data Engineer
Summary
Designs and builds data pipelines and analytics infrastructure using AWS services, SQL, Python, and big-data tools to support predictive modeling and business insights.
As a Data Engineer you will work closely with our Software Engineers’ team to design, build, secure, and maintain analytics solutions.
Requirements
- Build data systems and pipelines
- Evaluate business needs and objectives
- Interpret trends and patterns
- Prepare data for prescriptive and predictive modeling
- Build algorithms and prototypes
- Combine raw information from different sources
- Explore ways to enhance data quality and reliability
- Extract value insights from semi structured, structured data and non structured data
- Implement complex data aggregates and Business logic using SQL
Qualifications
- BS/MS degree in Computer Science, IT, Mathematics, Statistics or similar.
- At least 5 years of experience with data engineering and ETL technologies
- At least 2 years of hands-on experience working with AWS
- Experience and expertise working with AWS services to design, build, secure, and maintain analytics solutions
- Experience with AWS IoT Core/Analytics would be preferred
- Experience with big data technologies like Hadoop, Spark, Hive or similar frameworks.
- Advanced SQL skills.
- Experience in AWS Lambda, AWS Glue, AWS Athena and as AWS Redshift
- Experience in Python, Pandas or a similar modeling language.