Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Experion Technologies

NewBe an early applicant

Senior Data Engineer

Posted

Description

We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable, high-performance data pipelines and platforms on AWS. The role will focus on developing a modern Data Lakehouse architecture using AWS EMR, Python, PySpark, and Apache Iceberg, while orchestrating serverless and containerized workflows through Step Functions, Lambda, and ECS.

The ideal candidate will integrate diverse data sources across PostgreSQL and DynamoDB, ensuring data reliability, governance, and availability to support advanced analytics and data-driven decision-making.


1. Duties and Responsibilities

  • Design, develop, and maintain analytical data models and metrics using modern, scalable data platform technologies.
  • Architect and implement Data Lakehouse solutions on AWS using AWS EMR and Apache Iceberg.
  • Build, optimize, and maintain robust batch and incremental data pipelines using Python and PySpark.
  • Orchestrate and automate data workflows using AWS Step Functions, Lambda, and ECS.
  • Design and implement event-driven data processing solutions using AWS Lambda and Step Functions for near real-time data ingestion and transformation.
  • Build event-triggered pipelines that respond to data arrivals, system events, and business transactions (e.g., S3 events and DynamoDB Streams).
  • Design and manage data storage and access patterns across PostgreSQL and DynamoDB.
  • Ensure high performance, reliability, and scalability of data systems.
  • Collaborate with business stakeholders to translate requirements into effective data solutions.
  • Partner with architecture and operations teams to enforce best practices, standards, and governance.
  • Adhere to Information Security Management policies and procedures.


2. Job Specification / Technical Skills

  • Graduate degree in Computer Science, Engineering, or a related field.
  • 7+ years of overall professional experience in software development, with a focus on data and analytical platform development.
  • 4+ years of relevant hands-on experience in data engineering and big data ecosystems.
  • Strong expertise in the following technologies:
  • AWS EMR
  • Python
  • PySpark
  • Apache Iceberg
  • PostgreSQL
  • DynamoDB
  • Hands-on experience with AWS Step Functions, Lambda, and ECS for workflow orchestration and serverless/containerized processing.
  • Hands-on experience designing and implementing event-driven architectures on AWS, including event triggers, asynchronous processing, and decoupled workflows.
  • Experience working with DynamoDB.
  • Proven experience designing and implementing Data Lakehouse architectures on AWS.
  • Experience building highly scalable, low-latency data systems.
  • Experience working in Agile development environments.


3. Preferred Qualifications

  • Experience with Amazon Redshift for data warehousing.
  • Experience with AWS Glue for ETL and data cataloging.


4. Soft Skills and Competencies

  • Strong ability to learn and adapt to new technologies quickly.
  • Excellent problem-solving and analytical thinking skills.
  • Ability to work independently and collaboratively in a team environment.
  • Strong multitasking skills in a fast-paced, dynamic setting.
  • Excellent verbal and written communication skills.


Skills

What Senior Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →