Data Engineer Lead
Posted Updated
Description
Iris Software, Inc. is seeking a data engineer to design scalable data processing solutions using PySpark and modern distributed frameworks. You will define data ingestion, transformation, and processing architectures aligned with business and analytical objectives.
Collaborate with cross-functional teams to ensure high-quality data for analytics, governance, and streaming pipelines using AWS services like Lambda, Glue, and Kinesis.
Design scalable data engineering solutions using PySpark and modern distributed data processing frameworks. Define data ingestion, transformation, and processing architectures aligned with business and analytical objectives. Must have strong Python and advanced SQL skills. Experience with Spark/PySpark and distributed data processing. Ability to design data ingestion, transformation, and processing architectures. Experience with cloud platforms (AWS) and data pipelines. Knowledge of data quality and validation practices.Skills
Sign in to read and join the discussion.