Senior Data Engineer – Remote
Posted Updated
Description
Vytwo is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines using Python and PySpark, supporting both batch and streaming workloads on cloud platforms such as Databricks and Snowflake.
You will develop robust data models (OLTP/OLAP), optimize SQL, create Airflow workflows, and enforce data governance with Purview, collaborating with data architects, analysts, scientists, and business stakeholders to deliver scalable, reliable data solutions.
Design, build, and maintain scalable data pipelines using Python and PySpark for batch and streaming workloads Build and optimize data processing frameworks on cloud platforms such as Databricks or Snowflake Design and implement robust data models including OLTP and OLAP schemas Develop high quality SQL code with performance tuning Create and manage workflow orchestration using Airflow Implement data governance and metadata standards with Purview Build automated data quality and validation frameworks Collaborate with cross-functional teams to deliver scalable data solutions Lead design sessions and code reviews to promote best practices Support cloud infrastructure and DevOps practices including CI/CD Monitor and troubleshoot production data pipelines Contribute to evolution of the enterprise data platform 7+ years of experience in data engineering or software engineering Proficiency with Databricks or Snowflake Experience with orchestration tools such as Apache Airflow Experience with cloud ecosystems (Azure preferred; AWS/GCP acceptable) Advanced SQL skills and OLTP/OLAP data modeling Familiarity with data governance tools, especially Microsoft Purview Strong Python/PySpark programming skills If offered, ability to provide extensive personal information for security clearance and eligibility Remote work Career growth Competitive salarySkills
Sign in to read and join the discussion.