Senior Data Engineer
This is a remote position.
Job Title: Sr. Data Engineer
Our new AI Solutions division combines CAMP Systems' deep industry expertise with cutting-edge artificial intelligence to create transformative products for our customers. We're building a diverse portfolio of AI solutions that address complex industry challenges while setting new standards for innovation in the aviation Industry.
Our team unites self-motivated professionals who thrive on solving difficult problems and pushing technological boundaries. As a member of the core team, you'll have the unique opportunity to shape both our product roadmap and team culture, while working with the latest AI technologies.
Key Responsibilities:
-
Design, develop, and maintain high-performance, scalable, high-volume, and efficient ETL/ELT pipelines to extract, transform, and load data from various sources such as Oracle.
-
Create and optimize data models and schemas to support various use cases (such as AI/ML solutions, benchmarking, customer data delivery) in Snowflake and Redshift.
-
Ensure data quality, integrity/completeness, and governance by implementing best practices for monitoring and validation. Build automated monitoring and alerting mechanisms.
-
Collaborate with cross-functional teams to understand data requirements to support business objectives.
-
Stay up to date with emerging trends and technologies in data engineering.
Required Skills/Qualifications:
-
8-10 years of experience in building and maintaining ETL/ELT data pipelines using tools such as Informatica, Pentaho Data Integration, or other third-party tools.
-
5+ years of hands-on experience with relational databases such as Oracle and data modeling.
-
Strong programming skills in Python, SQL, or Scala.
-
3+ years of experience on data warehouse platforms such as Snowflake and Redshift.
-
Familiarity with data governance, security, and compliance best practices.
-
Keen eye for data accuracy, completeness, and privacy.
-
Familiarity with cloud services such as AWS and Azure.
-
Familiarity with version control systems (e.g., Git), JIRA, Confluence.
-
Experience in delivering customer-facing SaaS solutions.
-
Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
-
Strong problem-solving skills and the ability to optimize data processing workflows.
-
Excellent verbal and written communication and teamwork skills.
Desirable Skills:
-
Experience with AI and machine learning applications.
-
Understanding of containerization technologies like Docker.
-
Knowledge of CI/CD pipelines and DevOps practices.
Benefits:
-
Competitive salary and benefits package.
-
Opportunity to work on cutting-edge technologies and innovative projects.
-
Collaborative and inclusive work environment.
-
Professional development and growth opportunities.