Data Engineer
Summary
Build and optimize cloud-based data pipelines and warehouses using AWS, Databricks, and Informatica for healthcare analytics and AI/ML workloads.
- Key Skills: Oracle, MS SQL, MySQL, Teradata, Databricks, Informatica, AWS cloud services, ETL, ML, AI, IaC, CI/CD, Informatica IDMC Certification
- Degree/Master's in Computer Science, Information Technology, Computer Engineering, or equivalent.
- Minimum 5 years of experience in data warehousing, big data, or advanced analytics solutions.
- Experience with databases (e.g., Oracle, MS SQL, MySQL, Teradata, Databricks).
- Expertise in data repository design (e.g., operational data stores, data marts, data lakes).
- Proficiency in data query techniques (e.g., SQL, NoSQL, Spark SQL).
- Hands-on experience with Databricks (Delta Lake, MLflow, Spark).
- Experience with Informatica Data Management Cloud (IDMC) for data integration, transformation, and governance.
- Must-have: Strong knowledge of AWS cloud services (e.g., AWS Glue, Redshift, S3, Lambda, Kinesis, Athena, EMR).
- Experience in building and optimizing ETL/ELT workflows using AWS-native tools, Databricks, or IDMC.
- Understanding of event-driven architectures and microservices.
- Data modeling experience (e.g., Star Schema, Snowflake Schema).
- Proficiency in Python/R for data transformation, analytics, and statistical computing.
- Hands-on experience with ML and AI frameworks for predictive modeling and healthcare analytics.
- Experience in data visualization tools (e.g., Power BI, Tableau).
- Infrastructure as Code (IaC): Terraform, CloudFormation.
- CI/CD & DevOps best practices for data pipelines and cloud infrastructure.
- Identity and Access Management (IAM), security best practices, and data governance.
- Strong problem-solving and critical thinking skills.
- Ability to communicate complex technical solutions to non-technical stakeholders.
- Proven experience in working with cross-functional teams and managing multiple stakeholders.
- Healthcare data governance and compliance knowledge is a plus.
- AWS Certified Solutions Architect – Associate or Professional
- Databricks Certified Data Engineer
- Informatica IDMC Certification
Education & Experience:
Technical Skills:
Databases & Data Management:
Cloud Data & Analytics:
Data Analytics & Machine Learning:
DevOps & Security:
Soft Skills:
Certifications (Preferred but not mandatory)