Data Developer ( Oracle )
Summary
Mid-level data engineer migrating an Oracle data warehouse to Azure: analyzing Oracle packages/procedures and rebuilding them as PySpark and Azure Synapse pipelines, then testing and reconciling outputs against Oracle control totals. Core stack is PySpark, SQL, Azure Synapse, ADLS Gen2, and Git.
Data Developer (Oracle)
Focus: Oracle-to-PySpark Development
Position level
Mid-level, approximately 3-5 years of data engineering or ETL development experience, including at least 2 years of practical PySpark development.
Role purpose
Develop, test and reconcile Azure Synapse and PySpark datasets migrated from Oracle DWH packages, procedures, tables and views.
This person will work under the guidance of the senior engineers but should be able to own individual datasets or migration components from analysis through technical testing.
Primary responsibilities
• Analyze assigned Oracle packages, procedures, tables and views.
• Document:
o Input objects
o Output objects
o Filters
o Joins
o Derivations
o Aggregations
o Dependencies
o Error-handling behavior
• Convert approved Oracle transformations into PySpark.
• Develop Synapse notebooks and pipelines.
• Implement data processing across designated architecture layers.
• Create reusable functions and common transformation components.
• Implement incremental and historical processing.
• Develop automated data-quality and reconciliation tests.
• Compare Azure outputs against Oracle control totals.
• Investigate and resolve data differences.
• Optimize Spark transformations and SQL queries.
• Participate in code review and defect resolution.
• Maintain technical documentation and operational instructions.
• Support system integration testing, UAT and parallel runs.
Mandatory technical skills
• PySpark
• SQL
• Azure Synapse notebooks and pipelines
• Azure Data Lake Storage Gen2
• ETL or ELT development
• Data warehouse concepts
• Unit testing and data reconciliation
• Git-based development
• Troubleshooting and performance analysis
Preferred skills
• Oracle SQL and basic PL/SQL
• Migration from stored procedures to distributed data processing
• Delta Lake or Parquet
• Azure DevOps
• Dimensional-modelling concepts
• Power BI or reporting-data preparation
• Experience with enterprise batch processing
Expected mid-level capabilities
The successful candidate should be able to:
• Independently implement medium-complexity datasets.
• Read and understand existing SQL and PL/SQL.
• Follow established engineering standards.
• Recognize duplicated transformation logic and raise it for consolidation. • Explain data differences using evidence.
• Write maintainable, testable PySpark rather than translating PL/SQL line by line. • Escalate ambiguous business rules instead of making undocumented assumptions.
Expected deliverables
• PySpark notebooks
• Synapse pipelines
• Dataset configuration
• Unit-test scripts
• Reconciliation results
• Defect-analysis records
• Technical documentation
• Deployment artifacts
Skills
Sign in to read and join the discussion.