Data Engineer

Responsibilities

• Build, and maintain reliable and scalable ETL (Extract, Transform, Load) pipelines to process and store large amounts of structured and unstructured data
• Optimize and manage databases, including relational databases (SQL) and NoSQL databases (e.g., MongoDB, Cassandra)
• Integrate data from various internal and external sources, ensuring data quality and consistency
• Develop and maintain complex data models and schemas that meet business needs, including star and snowflake schema designs for data warehousing
• Design and implement data warehousing solutions, ensuring high performance, scalability, and availability
• Work with cloud platforms (e.g., AWS, Azure, GCP) to build and maintain cloud-based data infrastructure
• Automate repetitive data-related tasks, including data ingestion, validation, transformation, and storage
• Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver appropriate solutions
• Implement monitoring tools and troubleshoot any data pipeline or infrastructure issues to ensure data availability and integrity
• Combine raw information from different sources to create consistent and machine-readable formats
• Develop and test architectures that enable data extraction and transformation for predictive or prescriptive modeling

Quality Assurance

• Perform quality assurance
• Constantly be on the lookout for ways to improve monitoring, discover issues and deliver better value to the customer
• Identify and mitigate risks associated with the project

Qualifications

• Bachelor Degree or/and Diploma in Information Technology, Informatics, Computer Science, Engineering, or a related field
• Previous experience in cabling and circuit design environment
• Experience dealing with operation and application of electrical components
• Confidence with use and handling of common measurement instruments
• Provision of quality customer service when required

Knowledge

• In-depth and thorough knowledge of learning machine methods
• Core application functionality and application technology stack
• Strong Office 365 skills: Excel, Word, Visio and PowerPoint
• Microsoft technologies such as Microsoft SQL Server, Microsoft Exchange Server, SharePoint Portal Server, Microsoft BizTalk Server
• Understanding of the Software Development Life Cycle
• Understanding of the customer's business processes

Skills & Abilities

• Attention to Detail: Must pay attention to detail and be thorough in completing tasks.
• Troubleshooting: Must be able to examine, test and resolve issues quickly, ensuring quick and proper rectification of problem areas.
• Decision-making: Must be able to utilize their professional knowledge and make decisions confidently.
• Adaptability: Must be comfortable working in a dynamic and fast-paced environment, able to adapt quickly to changing circumstances.
• Integrity: Must demonstrate high ethical standards and integrity in all financial dealings.
• Initiative: Must be willing to take on responsibilities and challenges.
• Dependability: Must be reliable, responsible, and dependable in fulfilling obligations.
• Organisation: Must be able to formulate and maintain system records and system designs.
• Planning & Time Management: Must be able to plan efficiently and manage time effectively.