Remote Senior Data Engineer at Mitre Media
Posted 1
view
Summary
A Senior Data Engineer who architects and optimizes Databricks/Spark ETL pipelines for financial data, ensures data quality through monitoring, advances AWS/GCP cloud capabilities, and mentors a distributed team. Core stack: Databricks, Delta Lake, Python (plus Scala/Java), SQL, and cloud data services.
Take on the role of Remote Senior Data Engineer at Mitre Media, innovating in the FinTech space. Your expertise in Databricks and cloud data will drive impactful AI solutions.
In this position, you will lead the architecture of essential data infrastructure crucial for the functionality of Mitre Media's services. By designing robust ETL pipelines on Databricks and implementing advanced algorithms, you will improve data quality. You'll also guide a distributed team while enhancing cloud capabilities for optimal data performance.
Key Responsibilities: • Develop and optimize ETL workflows using Spark in Databricks • Transform financial data into actionable forms • Maintain data integrity through rigorous monitoring • Advance cloud solutions for efficiency and scalability • Provide mentorship and lead by example in best practices
Requirements: • Proficient in Python with knowledge of Scala or Java • Extensive experience with Databricks and Delta Lake • Strong analytical SQL and modular design skills • Background in cloud data services like AWS or GCP • Familiarity with financial markets essential
Become a key player in the FinTech revolution at Mitre Media and leverage your data engineering skills.
In this position, you will lead the architecture of essential data infrastructure crucial for the functionality of Mitre Media's services. By designing robust ETL pipelines on Databricks and implementing advanced algorithms, you will improve data quality. You'll also guide a distributed team while enhancing cloud capabilities for optimal data performance.
Key Responsibilities: • Develop and optimize ETL workflows using Spark in Databricks • Transform financial data into actionable forms • Maintain data integrity through rigorous monitoring • Advance cloud solutions for efficiency and scalability • Provide mentorship and lead by example in best practices
Requirements: • Proficient in Python with knowledge of Scala or Java • Extensive experience with Databricks and Delta Lake • Strong analytical SQL and modular design skills • Background in cloud data services like AWS or GCP • Familiarity with financial markets essential
Become a key player in the FinTech revolution at Mitre Media and leverage your data engineering skills.