Senior Software Engineer (Python/Data Engineering)

About the Role

Our client, a rapidly growing analytics firm, is seeking a highly skilled Senior Software Engineer with a strong background in Python and Data Engineering. This role is based in Upington, Northern Cape, where you will be instrumental in building and maintaining scalable data pipelines, optimizing data processing, and developing robust data solutions. You will work with large datasets, implement data warehousing strategies, and ensure the efficiency and reliability of our client's data infrastructure. The ideal candidate will have extensive experience in Python development, data modeling, and cloud-based data platforms. This is an excellent opportunity to contribute to data-driven decision-making within a dynamic and forward-thinking organization located in Upington, Northern Cape, operating under a hybrid work model.

Key Responsibilities

• Design, develop, and maintain scalable and efficient data pipelines using Python and related technologies.
• Build and optimize data processing jobs, ensuring data quality, integrity, and timely availability.
• Develop and manage data warehouses and data lakes, implementing effective data modeling techniques.
• Integrate data from various sources into a unified and accessible format.
• Collaborate with data scientists, analysts, and other engineers to understand data needs and deliver solutions.
• Implement data security and governance best practices.
• Optimize database performance and query efficiency.
• Automate data-related tasks and processes.
• Troubleshoot and resolve data pipeline issues and performance bottlenecks.
• Stay updated with emerging technologies in data engineering and big data.

Requirements

• Bachelor's degree in Computer Science, Engineering, Data Science, or a related field, or equivalent practical experience.
• 5+ years of professional experience in software engineering, with a strong focus on data engineering.
• Expertise in Python programming and its data-related libraries (e.g., Pandas, NumPy, SQLAlchemy).
• Strong experience with SQL and relational database systems (e.g., PostgreSQL, MySQL).
• Experience with big data technologies such as Apache Spark or Hadoop is a plus.
• Familiarity with cloud platforms (AWS, Azure, GCP) and their data services.
• Knowledge of data warehousing concepts and ETL/ELT processes.
• Experience with version control systems (Git).
• Excellent problem-solving, analytical, and communication skills.
• Ability to work effectively in a hybrid team environment based in Upington, Northern Cape.

Benefits

• Our client offers a competitive salary, performance bonuses, comprehensive medical aid and retirement benefits, opportunities for professional development and training, and a collaborative work environment.

This role provides a chance to work on impactful data projects and grow your career within an analytics-focused company.