AI/ML Data Engineer - Scalable Data Solutions
Summary
Build and maintain scalable data pipelines, ETL/ELT processes, and data warehouse/lake solutions that power a client's AI and ML initiatives, working fully remotely. Core stack: SQL, Python or Scala, big data tools like Spark/Hadoop, and cloud data services on AWS, Azure, or GCP.
About the Role
Our client is seeking a skilled AI/ML Data Engineer to design, build, and maintain scalable data solutions that fuel their AI & Emerging Technologies initiatives. This role offers a flexible, fully remote work arrangement, allowing you to contribute from anywhere. You will be responsible for developing robust data pipelines, ensuring data quality, and optimizing data access for machine learning models and analytical applications. This is an excellent opportunity to work with large-scale datasets and cutting-edge technologies, playing a vital role in enabling advanced AI capabilities. You will collaborate closely with data scientists, ML engineers, and software developers to ensure seamless data flow and accessibility. The ideal candidate is proficient in data engineering best practices, possesses strong programming skills, and has a passion for building efficient and reliable data infrastructure to support AI innovation.
Key Responsibilities
- Design, build, and maintain scalable and robust data pipelines for AI/ML applications.
- Develop ETL/ELT processes to ingest, transform, and load data from various sources.
- Ensure data quality, integrity, and availability for downstream consumption.
- Optimize data storage and processing for performance and cost-efficiency.
- Implement data governance and security best practices.
- Collaborate with data scientists and ML engineers to understand their data requirements.
- Develop and manage data warehousing and data lake solutions.
- Monitor data pipeline performance and troubleshoot issues.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
- Proven experience as a Data Engineer, with a focus on building data pipelines for analytics or ML.
- Proficiency in SQL and experience with relational and NoSQL databases.
- Strong programming skills in Python or Scala.
- Experience with big data technologies such as Apache Spark, Hadoop, or similar.
- Familiarity with cloud platforms (AWS, Azure, GCP) and their data services.
- Knowledge of data warehousing concepts and ETL/ELT tools.
- Excellent problem-solving and analytical skills.
- Ability to work effectively in a remote team environment.
Benefits
- Competitive salary and potential for annual bonuses.
- Comprehensive health and wellness benefits package.
- Generous paid time off and holiday leave.
- Opportunities for continuous learning and professional development.
- Access to advanced data engineering tools and cloud environments.
- Fully remote work arrangement with flexibility.
- Collaborative and innovative work culture.