Sr. Data Engineer
Description
- Execute the business analytics agenda in conjunction with analytics team leaders
- Work with best-in-class external partners who leverage analytics tools and processes
- Use models/algorithms to uncover signals/patterns and trends to drive long-term business performance
- Execute the business analytics agenda using a methodical approach that conveys to stakeholders what business analytics will deliver
- Using data analysis to make recommendations to analytic leaders
- Understanding in best-in-class analytics practices
- Knowledge of Indicators (KPIs) and scorecards
- Knowledge of BI tools like Tableau, Excel, Alteryx, R, Python, etc. is a plus
- Design and Build: Develop and implement scalable, secure, and cost-effective cloud-based data solutions.
- Manage Data Pipelines: Develop and maintain data pipelines to extract, transform, and load data into data warehouses or data lakes.
- Ensure Data Quality: Implement data quality and validation processes to ensure data accuracy and integrity.
- Optimize Data Processing Storage: Ensure efficient data processing of pipelines data storage for optimal retrieval performance.
- Collaborate and Innovate: Work closely with data architects, data modelers, data product managers, and stay updated with the latest cloud technologies and best practices.
- Mentoring: Guide groom associate data engineers data engineers (external/internal) to ensure timely deliverables fulfilling all data engineering guidelines standards.
- Programming: Python, PySpark, SQL
- ETL Integration: Databricks (LDP, Lakeflow Connect, Notebooks), AecorSoft/DataSphere
- Data Warehousing: SCD Types, Fact Dimensions, Star Schema, ETL
- Data Modeling: Dimensional modelling understanding, Erwin tool (Optional)
- Medallion Architecture: Bronze, Silver, Gold (Databricks Medallion Architecture)
- AWS Cloud Services: S3, Lambda, EC2, Glue, Redshift
- GenAI exposure: Genie/Kiro/Gemini etc.
- Scheduling Technologies: Lakeflow Jobs, Airflow
- Visualization (Optional): PowerBI (Optional), GenBI (Optional)
- Problem-Solving: The ability to identify and solve complex data-related challenges.
- Communication: Effective communication skills to collaborate with Engineering Leads, Data Product Managers, Data Modeler, Data Analysts, and stakeholders.
- Analytical Thinking: The capacity to analyze data and draw meaningful insights.
- Attention to Detail: Meticulousness in data preparation and pipeline development.
- Adaptability: The ability to stay updated with emerging technologies and trends in the data engineering field.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.