Senior Data Engineer
Summary
Build and optimize data pipelines and Databricks Lakehouse architectures using SQL, PySpark, and AWS for financial-services clients.
Job Title: Senior Data Engineer
Key Skills: SQL, Databricks, PySpark, Data Engineering, PostgreSQL, AWS
Experience: 3+ YOE.
Location: Costa Rica, Peru, Colombia, and Bolivia.
Mode: Remote.
We at Coforge are hiring Senior Data Engineer (#22328) with the following skill set.
Key Responsibilities
· Write, optimize, and maintain complex SQL across MySQL, Aurora PostgreSQL, SQL Server, and Databricks (Spark SQL).
· Design, develop, and support data ingestion pipelines using API integrations, file ingestion, CDC patterns, and modern data engineering practices.
· Build and optimize Databricks Lakehouse architectures following the Medallion model (Bronze, Silver, Gold).
· Own and enhance stored procedures, views, and functions supporting production business workflows and reporting processes.
· Perform database performance tuning, query optimization, execution plan analysis, indexing, and partitioning strategies.
· Design and maintain dimensional models and star schemas for analytical workloads.
· Collaborate closely with software engineering teams on data access patterns, integrations, migrations, and API data contracts.
· Support data migration initiatives, data validation, reconciliation processes, and production go-live activities.
· Implement and maintain ETL/ELT processes with automated testing, monitoring, alerting, and data quality controls.
· Contribute to data governance, security, lineage tracking, and compliance requirements across enterprise data platforms.
Required Skills & Qualifications
· Bachelor’s degree in Computer Science, Information Systems, or a related field.
· 3+ years of hands-on experience writing production-grade SQL.
· Strong expertise with at least two relational databases such as MySQL, PostgreSQL, SQL Server, or Oracle.
· Advanced knowledge of CTEs, window functions, recursive queries, query plan analysis, and stored procedure development.
· 2+ years of experience building data processing pipelines using Python or PySpark.
· Experience designing and maintaining dimensional models and star schemas.
· Solid understanding of software engineering fundamentals including Git, CI/CD pipelines, code reviews, and Agile/Scrum methodologies.
· Experience working with distributed and offshore teams across multiple time zones.
· Strong analytical, troubleshooting, and problem-solving skills.
Preferred Skills
· Experience with Databricks, Lakehouse architecture, and Medallion patterns (Bronze/Silver/Gold).
· Experience with AWS services such as Aurora, Glue, S3, Lambda, and EventBridge.
· Background in Financial Services, Loan Servicing, or FinTech environments.
· Familiarity with event-driven architectures, CDC patterns, Kafka, or MSK.
· Experience with data governance, security controls, and handling PII or sensitive financial data.
· Experience with OutSystems or other low-code platforms.
· Experience using AI-assisted development tools such as Claude Code or similar solutions.
· Exposure to Databricks Mosaic AI or other LLM-powered data technologies.
Posted On: 14-08-2026
At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.