Senior Data Engineer: On-Prem & Cloud Big Data Pipelines
Posted 3
views
Summary
Senior Data Engineer at Pyramid Consulting building and scaling data analytics pipelines on on-premise and cloud platforms like Hadoop and Databricks. Day-to-day work centers on designing robust pipelines and optimizing performance using Python, Spark, SQL, Airflow, and NiFi, with CI/CD and testing practices.
Pyramid Consulting, Inc is seeking a Senior Data Engineer to help build and scale data analytics products on on-premise and cloud platforms such as Databricks and Hadoop. You will design robust pipelines, optimize performance, and partner with Product Managers to translate use cases into data modules.
The role emphasizes Python, Spark, SQL, and tools like Airflow and NiFi, with an eye toward CI/CD, testing, and maintainable code.