Data Engineer Senior
Posted Updated
Description
Wipro Limited in Curitiba, Brazil, seeks an experienced Data Engineer to design and maintain enterprise-scale data solutions. You will build ETL/ELT pipelines using Databricks, Apache Spark, PySpark, Hadoop, SQL and Python for robust data processing.
Responsibilities include data quality, monitoring, and automated testing; collaborate with cloud platforms; mentor junior engineers; contribute to CI/CD and Airflow workflows to deliver scalable, reliable data solutions.
Design and maintain enterprise-scale data pipelines. Build ETL/ELT processes with Databricks, Spark, PySpark. Collaborate with cloud platforms and data storage teams. Implement data quality, monitoring, and automated testing. Mentor junior engineers and support CI/CD workflows. Contribute to Airflow workflow development. Strong experience developing and maintaining enterprise-scale data engineering solutions. Hands-on with Databricks, Spark, PySpark, Hadoop, SQL, Python. Experience building ETL/ELT pipelines and large-scale data processing. Experience with cloud-based data platforms and storage. Knowledge of data modeling concepts and analytical data structures. Experience implementing automated testing, monitoring, and data quality practices. Experience with data formats (Parquet, Avro, ORC). Knowledge of CI/CD pipelines, Git-based development workflows, and DevOps principles. Experience with Airflow. Strong analytical and problem-solving skills; mentoring engineers.Skills
Sign in to read and join the discussion.