Azure Data Engineer
Summary
Builds Azure pipelines to ingest and move data from on-prem systems like mainframes and SQL Server into cloud storage and analytics tools using Python, SQL, and orchestration platforms.
Direct message the job poster from Epsilon Solutions Ltd.
Job Description
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
Required Qualifications
- Experience in Azure ingestion from on‑prem source, e.g. mainframe, SQL server, Oracle.
- Experience in Sqoop / Hadoop.
- Microsoft Excel for metadata files with requirements for ingestion.
- Any other certificate in Azure/AWS/GCP and data engineering hands‑on experience in cloud.
- Strong programming skills with at least one of Python, Scala or Java.
- Strong SQL skills (T‑SQL or PL‑SQL).
- Data files movement via mailbox.
- Source‑code versioning/promotion tools, e.g. Git/Jenkins.
- Orchestration tools, e.g. Autosys, Oozie.
- Source‑code versioning with Git.
Nice‑to‑Have Skills
- Experience working with mainframe files.
- Experience in Agile environment, JIRA/Confluence.
Seniority Level
- Mid‑Senior level
Employment Type
- Full‑time
Job Function
- Information Technology
Industries
- IT Services and IT Consulting, IT System Data Services, and Software Development
Location / Salary
New York, NY $75,000.00-$80,000.00 4 months ago
Miscellaneous
Referrals increase your chances of interviewing at Epsilon Solutions Ltd. by 2x.