Data Engineer | Databricks
Summary
Data Engineer at Universal Robina Corporation builds and manages data pipelines that move data from sources into data lakes and warehouses, using Databricks on Azure with Python/PySpark and SQL. Also improves data quality, automates processes, and visualizes data with BI tools like Power BI, Tableau, or Qlik.
Universal Robina Corporation is looking for a Data Engineer. Responsible for building data pipelines that are used to transport data from a data source to data lake and/or data warehouse
What are the Job Responsibilities:
- Design, develop and manage data pipelines and orchestrate data integration that meets business requirements.
- Identify, design and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
- Work with data and analytics experts to strive for greater functionality in our data systems.
- Ensure the data is complete, has been cleansed, and that the rules have been established for outliers (eliminate, ignore, average out and so on).
- Identifying patterns, trends and correlations in data sets.
- Explore ways to enhance data quality and reliability.
- Collaborate with data analyst and architect on several projects.
- Transforming data sets, quantitative and qualitative analysis into compelling visuals.
What are the Qualifications?
- Candidate must possess at least a Bachelor's/College Degree in Computer Science/Information Technology, Mathematics or equivalent.
- At least 3 year(s) of working experience in the related field is required for this position.
- Experience with Azure cloud services is a must.
- With an in-depth understanding of Data bricks, Data Lake store and Data Warehouse.
- Experienced in using Python or PySpark
- Advanced knowledge of SQL and data visualization experience using any BI tool: Microsoft Power BI, Tableau, Qlik.
NOTE: Universal Robina Corporation does not collect fees throughout our recruitment process and does not collaborate with any travel agency or third party to provide accommodation or other services to job applicants. All URC recruitment processes happen in our respective offices or plants. Recruitment processes are only carried out by our Talent Acquisition teams with an official corporate email address.