Data Engineer
Summary
Designs, builds, and maintains ETL/ELT data pipelines, Snowflake databases/models, and API-based integrations across enterprise systems, plus AI-enabled workflows (Snowflake Cortex, Bedrock, RAG). Core stack: SQL, Python, Snowflake, and AWS/Azure cloud services.
- Design, develop, test, deploy, and maintain ETL/ELT pipelines across enterprise applications, APIs, databases, cloud platforms, file systems, and event-driven services.
- Build and support data integrations using REST and GraphQL APIs, cloud storage, secure file transfers, database connectors, and message-based architectures.
- Develop, optimize, and maintain Snowflake databases, data models, data marts, analytical datasets, and enterprise reporting solutions.
- Create scalable data solutions using SQL, Python, Snowpark, cloud services, and automation tools to support business operations and analytics initiatives.
- Build AI-enabled data pipelines and workflows utilizing technologies such as Snowflake Cortex, Amazon Bedrock, embeddings, vector search, document processing, and retrieval-augmented generation (RAG).
- Monitor data pipelines, troubleshoot production issues, conduct root cause analysis, and implement long-term corrective solutions to ensure reliability and performance.
- Develop technical documentation, architecture diagrams, operational runbooks, and support procedures for deployed solutions.
- Collaborate with cross-functional teams to identify automation opportunities, improve data quality, streamline business processes, and enhance enterprise reporting capabilities.
- Support enterprise data governance initiatives, metadata management, security controls, and best practices for data management.
- Contribute to technical standards, reusable frameworks, engineering best practices, and continuous improvement initiatives.
QUALIFICATIONS & REQUIREMENTS:
- You must hold a Bachelor's degree in Computer Science, Software Engineering, Information Systems, Data Engineering, Mathematics, or a related field, or possess equivalent professional experience.
- You must have at least 4 years of experience in Data Engineering, Software Engineering, Analytics Engineering, Data Integration, or a related discipline.
- You must have advanced SQL skills, including complex data transformations, performance optimization, procedural logic, and data modeling.
- You must possess strong Python programming skills and experience developing production-grade applications, services, or data-processing solutions.
- You must have hands-on experience designing, developing, and supporting ETL/ELT pipelines within cloud or enterprise environments.
- You must have experience working with modern cloud data platforms such as Snowflake, AWS, Azure, Databricks, or similar technologies.
- You must have experience integrating enterprise applications using APIs, databases, cloud services, and event-driven architectures.
- You must demonstrate strong analytical thinking, troubleshooting, technical documentation, and problem-solving skills.
- You must be capable of independently managing projects, making sound technical decisions, and supporting production environments with minimal supervision.
- You must possess excellent written and verbal English communication skills and be comfortable participating in technical discussions with global stakeholders.
PREFERRED QUALIFICATIONS:
- Advanced experience with Snowflake, including Snowpark, Streams, Tasks, Dynamic Tables, Stored Procedures, and performance optimization.
- Experience with AWS serverless technologies, orchestration services, monitoring tools, and cloud security best practices.
- Exposure to Generative AI, Snowflake Cortex, Amazon Bedrock, document intelligence, embeddings, vector databases, and RAG implementations.
- Experience integrating enterprise platforms such as Oracle Fusion, ServiceNow, Salesforce, Microsoft Graph, or monitoring solutions.
- Knowledge of BI and analytics platforms such as Amazon QuickSight, Power BI, Tableau, or similar tools.
- Experience working within managed services, consulting, technology services, or multi-customer enterprise environments.
Skills
- AI
- Analytics
- API
- Automation
- AWS
- AWS Bedrock
- Azure
- Cloud
- Cloud Security
- Data Engineering
- Data Governance
- Data Modeling
- Data Pipelines
- Data Quality
- Databricks
- ELT
- Embeddings
- ETL
- Event Driven Architecture
- Generative AI
- GraphQL
- Metadata Management
- Oracle
- Power BI
- Python
- RAG
- Root Cause Analysis
- Salesforce
- Serverless
- ServiceNow
- Snowflake
- Snowpark
- SQL
- Tableau
- Vector Databases
- Vector Search