Data Engineer (Cloud)
Summary
Design and build cloud-based data pipelines and warehouses using AWS, Databricks, and Informatica to support healthcare analytics and reporting.
Responsibilities
- Experience with databases (e.g., Oracle, MS SQL, MySQL, Teradata, Databricks).
- Expertise in data repository design (e.g., operational data stores, data marts, data lakes).
- Proficiency in data query techniques (e.g., SQL, NoSQL, Spark SQL).
- Hands-on experience with Databricks (Delta Lake, MLflow, Spark).
- Experience with Informatica Data Management Cloud (IDMC) for data integration, transformation, and governance.
- Strong knowledge of AWS cloud services (e.g., AWS Glue, Redshift, S3, Lambda, Kinesis, Athena, EMR).
- Build and optimize ETL/ELT workflows using AWS-native tools, Databricks, or IDMC.
- Understand event-driven architectures and microservices.
- Perform data modeling (e.g., Star Schema, Snowflake Schema).
- Use Python/R for data transformation, analytics, and statistical computing.
- Work with ML and AI frameworks for predictive modeling and healthcare analytics.
- Develop reports and dashboards using Power BI or Tableau.
- Implement Infrastructure as Code (IaC) using Terraform and CloudFormation.
- Apply CI/CD and DevOps best practices for data pipelines and cloud infrastructure.
- Ensure Identity and Access Management (IAM), security best practices, and data governance.
- Communicate complex technical solutions to non-technical stakeholders.
- Collaborate with cross-functional teams and manage multiple stakeholders.
Requirements
- Degree/Master's in Computer Science, Information Technology, Computer Engineering, or equivalent.
- Minimum 5 years of experience in data warehousing, big data, or advanced analytics solutions.
- Minimum Relevant Experience: 5 Years.
- Start Date: Immediate.
- Key Skills: Oracle, MS SQL, MySQL, Teradata, Databricks, Informatica, AWS cloud services, ETL, ML, AI, IaC, CI/CD, Informatica IDMC Certification.
- Strong problem-solving and critical thinking skills.
- Ability to communicate complex technical solutions to non-technical stakeholders.
- Proven experience in working with cross-functional teams and managing multiple stakeholders.
- Healthcare data governance and compliance knowledge is a plus.
- Preferred Certifications (Not Mandatory):
- AWS Certified Solutions Architect – Associate or Professional
- Databricks Certified Data Engineer
- Informatica IDMC Certification