Senior Data Engineer
Summary
Designs, builds, and maintains data pipelines and analytics solutions using AWS, SQL, and big data tools to process structured and unstructured data.
As a Data Engineer you will work closely with our Software Engineers’ team to design, build, secure, and maintain analytics solutions.
Requirements
- Build data systems and pipelines
- Evaluate business needs and objectives
- Interpret trends and patterns
- Prepare data for prescriptive and predictive modeling
- Build algorithms and prototypes
- Combine raw information from different sources
- Explore ways to enhance data quality and reliability
- Extract value insights from semi-structured, structured data and non-structured data
- Implement complex data aggregates and business logic using SQL
Qualifications
- BS/MS degree in Computer Science, IT, Mathematics, Statistics or similar.
- At least 5 years of experience with data engineering and ETL technologies
- At least 2 years of hands-on experience working with AWS
- Experience and expertise working with AWS services to design, build, secure, and maintain analytics solutions
- Experience with AWS IoT Core/Analytics would be preferred
- Experience with big data technologies like Hadoop, Spark, Hive or similar frameworks.
- Advanced SQL skills.
- Experience in AWS Lambda, AWS Glue, AWS Athena and as AWS Redshift
- Experience in Python, Pandas or a similar modeling language.