Sr Data Engineer-AWS
Job Title: Senior Data Engineer
Location: Remote
Experience: 5–8 Years
Employment Type: Full-Time
About the Role
Aptus Data Labs is looking for a talented and
proactive Senior Data Engineer to help build the backbone of our
enterprise data and AI initiatives. You’ll work on modern data lake
architectures and high-performance pipelines in AWS, enabling real-time
insights and scalable analytics.
This role reports to the Head – Data Platform and AI
Lead, offering a unique opportunity to be part of a cross-functional team
shaping the future of data-driven innovation.
Key Responsibilities
Data Engineering & Pipeline Development
- Design
and develop reliable, reusable ETL/ELT pipelines using AWS Glue, Python,
and Spark.
- Process
structured and semi-structured data (e.g., JSON, Parquet, CSV) efficiently
for analytics and AI workloads.
- Build
automation and orchestration workflows using Airflow or AWS Step
Functions.
Data Lake Architecture & Integration
- Implement
AWS-native data lake/lakehouse architectures using S3, Redshift, Glue
Catalog, and Lake Formation.
- Consolidate
data from APIs, on-prem systems, and third-party sources into a
centralized platform.
- Optimize
data models and partitioning strategies for high-performance queries.
Security, IAM & Governance Support
- Ensure
secure data architecture practices across AWS components using encryption,
access control, and policy enforcement.
- Implement
and manage AWS IAM roles and policies to control data access across
services and users.
- Collaborate
with platform and security teams to maintain compliance and audit
readiness (e.g., HIPAA, GxP).
- Apply
best practices in data security, privacy, and identity management in cloud
environments.
DevOps & Observability
- Automate
deployment of data infrastructure using CI/CD pipelines (GitHub Actions,
Jenkins, or AWS CodePipeline).
- Create
Docker-based containers and manage workloads using ECS or EKS.
- Monitor
pipeline health, failures, and performance using CloudWatch and custom
logs.
Collaboration & Communication
- Partner
with the Data Platform Lead and AI Lead to align engineering efforts with
AI product goals.
- Engage
with analysts, data scientists, and business teams to gather requirements
and deliver data assets.
- Contribute
to documentation, code reviews, and architectural discussions with clarity
and confidence.
Required Qualifications
- Bachelor’s
degree in Computer Science, Engineering, or equivalent.
- 5–8
years of experience in data engineering, preferably in AWS cloud
environments.
- Proficient
in Python, SQL, and AWS services: Glue, Redshift, S3, IAM, Lake Formation.
- Experience
managing IAM roles, security policies, and cloud-based data access
controls.
- Hands-on
experience with orchestration tools like Airflow or AWS Step Functions.
- Exposure
to CI/CD practices and infrastructure automation.
- Strong
interpersonal and communication skills—able to convey technical ideas
clearly.
- Proficiency
in Databricks, Unity Catalog, and Spark-based distributed
data processing.
- Background
in Pharma, Life Sciences, or other regulated environments (GxP, HIPAA).
- Experience
with EMR, Snowflake, or hybrid-cloud data platforms.
- Experience
with BI/reporting tools such as Power BI or QuickSight.
- Knowledge
of integration tools (Boomi, Kafka) or real-time streaming frameworks.
Ready to build data solutions that fuel AI innovation?
Join Aptus Data Labs and play a key role in transforming
raw data into enterprise intelligence.