Senior Data Engineer
Summary
Senior data engineer at IT services firm Coforge owning a client (BNA) data pipeline end to end: pipeline architecture and orchestration, eligibility/consent/suppression logic, activation file delivery via SFTP, CI/CD-governed releases, and production monitoring and incident response. Core stack is advanced SQL, Python/Spark, Databricks, and Git/Azure DevOps.
BNA Principal Data Engineer. Own BNA pipeline architecture, orchestration and production readiness. Implement and review arbitration, eligibility, suppression, consent, contact-policy and cooldown logic. Own activation datasets/files, manifests, delivery status and SFTP integration. Sequence and approve PRs; enforce end-to-end, regression and production validation. Own production cutover, rerun/recovery, observability, alerting and incident technical response.
Mandatory Skills:
- Advanced SQL
- Python/Spark
- Databricks data engineering
- workflow orchestration
- dependency management
- idempotency
- scheduled/triggered jobs
- CI/CD
- Git/Azure DevOps
- PR review
- unit/integration testing
- environment promotion
- production support
- DQ controls
- alerting
- reconciliation
- incident diagnosis
Nice to have:
- CRM decisioning
- customer eligibility/consent and activation
- practical Comarch and/or SFMC/SFTP interface experience
Skills
Sign in to read and join the discussion.