Data Engineer
Posted Updated
Description
Hi,
Hope you are doing great!
Currently, we have an opening for a Data Engineer for our direct client in Baton Rouge, LA - (Remote). The position details are given below. If you are interested, you can email me or call me.
Job Details:
Title: Data Engineer
Duration: 12+ Months
Location: Baton Rouge, LA - Remote
The scope of the proposed services will include the following:
- Assess feasibility and technical requirements for LINKS → DataLake integration.
- Collaborate with OPH Immunization Program, OPH Bureau of Health Informatics and STChealth on data specifications and recurring ingestion pipelines.
- Build and optimize ETL workflows for LINKS and complementary datasets (Vital Records, labs, registries).
- Design scalable data workflows to improve data quality, integrity, and identity resolution.
- Implement data governance, observability, and lineage tracking across all pipelines.
- Mentor engineers, support testing, and enforce best practices in orchestration and architecture.
- Document and communicate technical solutions to technical and non-technical stakeholders.
Expertise and/or relevant experience in the following areas are mandatory:
- 3 years of experience in data engineering and/or data architecture
- 2 years of experience with Python for ETL and automation (pandas, requests, API integration).
- 2 years hands-on experience with SQL queries, stored procedures, performance tuning (preferably Oracle, SQL Server, MySQL)
- 1 year experience with ETL orchestration tools (Prefect, Airflow or equivalent).
- 1 year experience with cloud platforms (Azure, AWS, or GCP), including data onboarding/migration.
- 1 year exposure to data lake/medallion architecture (bronze, silver, gold)
- 2 years of experience providing written documentation and verbal communication for cross-functional collaboration.
Expertise and/or relevant experience in the following areas are desirable but not mandatory:
- 5+ years of experience in data engineering roles
- Experience integrating or developing REST/JSON or XML APIs
- Familiarity with CI/CD pipelines (GitHub Actions, Azure DevOps, etc.).
- Exposure to Infrastructure as Code experience (Terraform, CloudFormation).
- Experience with data governance and metadata tools (Atlan, OpenMetadata, Collibra).
- Public health/healthcare dataset or similar experience, including PHI/PII handling.
- Familiarity with SAS and R workflows to support epidemiologists and analysts.
- Experience with additional SQL platforms (Postgres, Snowflake, Redshift, BigQuery).
- Familiarity with data quality frameworks (Great Expectations, Deequ).
- Experience with real-time/streaming tools (Kafka, Spark Streaming).
- Familiarity with big data frameworks for large-scale transformations (Spark, Hadoop).
- Knowledge of data security and compliance frameworks (HIPAA, SOC 2, etc.).
- Agile/SCRUM team experience.
Skills
- Agile
- Airflow
- API
- Automation
- AWS
- Azure
- Azure DevOps
- Big Data
- BigQuery
- CI/CD
- Cloud
- CloudFormation
- Collibra
- Data Engineering
- Data Governance
- Data Lake
- Data Quality
- DevOps
- ETL
- GCP
- GitHub
- GitHub Actions
- Hadoop
- Hipaa
- Infrastructure as Code
- JSON
- Kafka
- Medallion Architecture
- MySQL
- Observability
- Oracle
- pandas
- PostgreSQL
- Prefect
- Python
- Redshift
- SAS
- Scrum
- Snowflake
- SOC 2
- Spark
- SQL
- SQL Server
- Terraform
- XML
