Data Engineer
Summary
The Data Engineer will design, build, and maintain scalable ETL/ELT pipelines and data infrastructure to support analytics and machine learning initiatives. The role involves collaborating with cross-functional teams to ensure data quality, performance, and security across cloud-based data systems.
Job Summary
We are seeking a talented and driven Data Engineer to join our growing data team. In this role, you will be responsible for designing, constructing, installing, testing, and maintaining highly scalable data management systems. You will collaborate closely with Data Scientists, Software Engineers, and Business Analysts to understand data needs and deliver robust data pipelines that power our company's analytics and machine learning initiatives.
Core Responsibilities
- Build Data Pipelines: Design, develop, and maintain automated, scalable ETL/ELT (Extract, Transform, Load) pipelines to ingest data from a variety of sources (APIs, databases, logs, third-party tools), or any similar platforms.
- Infrastructure Design: Architect and optimize data warehouses, data lakes, and database schemas to ensure high performance, reliability, and scalability.
- Data Architecture: Build and optimize scalable cloud data warehouses, data lakes, and database schemas to support high-performance analytics.
- Data Quality & Monitoring: Implement automated data validation, error handling, and alerting mechanisms to ensure the highest standards of data integrity, accuracy, and uptime.
- Performance Optimization: Continually monitor and tune database queries, pipeline workflows, and storage configurations to minimize latency and manage cloud infrastructure costs.
- Cross-Functional Collaboration: Partner with data analysts and business stakeholders to model data into clean, accessible formats, and support data scientists in deploying machine learning features.
- Security & Compliance: Ensure all data pipelines and storage solutions adhere to company security policies and data governance regulations (e.g., GDPR, CCPA).
Required Skills & Qualifications
- Programming:Proficient inPython,Java, orScala,or any similar programming language.
- Advanced knowledge in Database Expertise, Big Data & Warehousing, Workflow Orchestration, and Cloud Platform.
- Experience: At least 2 years of professional experience specifically in data engineering, data architecture, or software engineering with a heavy data focus.
- Education: Bachelor’s degree in Computer Science, Information Technology, Software Engineering, or a related quantitative field (equivalent practical experience will also be considered).
- Team player and keen on details.
What We Offer
- Hybrid Work Set-up and Remote Work (Flexible Work)
- Competitive Salary and Allowances
- 30 Leave Credits Annually
- HMO and Insurance
- Great Working Environment
- Learning and Development Opportunities