Data Engineer
Posted Updated
Description
Sigmasoftware2 seeks a Data Engineer to design, develop, and maintain scalable data pipelines in a remote setting. The role focuses on Python development, Spark processing, real-time streaming with Kafka, and Snowflake-based data solutions across AWS cloud services.
Applicants should have 4+ years of experience, strong data modeling knowledge, and excellent problem-solving and communication skills. English fluency is required; remote collaboration with international teams is expected.
Design, develop, and maintain scalable ETL/ELT pipelines. Build and optimize data processing solutions using Python and Apache Spark. Develop and support real-time data streaming applications using Kafka. Design and implement enterprise data solutions leveraging Snowflake. Build cloud-native data architectures and services on AWS. Ensure data quality, reliability, scalability, and performance across the data ecosystem. Troubleshoot, monitor, and optimize production data pipelines. Participate in technical discussions, code reviews, and engineering best practice initiatives. Collaborate with cross-functional teams to support data-driven business initiatives. 4+ years of professional experience as a Data Engineer. Strong experience with Python development. Hands-on experience with Apache Spark. Strong knowledge of Snowflake. Experience building and maintaining ETL/ELT pipelines. Experience with Apache Kafka and event-driven architectures. Experience working with AWS cloud services. Understanding of data modeling and data warehousing concepts. Strong analytical, problem-solving, and communication skills. Ability to work effectively in distributed teams. Upper-Intermediate English level or higher. Experience with large-scale E-commerce platforms is a plus. Familiarity with real-time analytics systems. Knowledge of infrastructure automation and CI/CD practices. Experience optimizing high-volume data processing pipelines. Understanding of distributed systems concepts.Skills
Sign in to read and join the discussion.