Data Engineer

Responsibilities Build, and maintain reliable and scalable ETL (Extract, Transform, Load) pipelines to process and store large amounts of structured and unstructured data Optimize and manage databases, including relational databases (SQL) and No SQL databases (e.g., Mongo DB, Cassandra) Integrate data from various internal and external sources, ensuring data quality and consistency Develop and maintain complex data models and schemas that meet business needs, including star and snowflake schema designs for data warehousing Design and implement data warehousing solutions, ensuring high performance, scalability, and availability Work with cloud platforms (e.g., AWS, Azure, GCP) to build and maintain cloud-based data infrastructure Automate repetitive data-related tasks, including data ingestion, validation, transformation, and storage Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver appropriate solutions Implement monitoring tools and troubleshoot any data pipeline or infrastructure issues to ensure data availability and integrity Combine raw information from different sources to create consistent and machine-readable formats Develop and test architectures that enable data extraction and transformation for predictive or prescriptive modeling Quality Assurance Perform quality assurance Constantly be on the lookout for ways to improve monitoring, discover issues and deliver better value to the customer Identify and mitigate risks associated with the project Qualifications Bachelor Degree or/and Diploma in Information Technology, Informatics, Computer Science, Engineering, or a related field Previous experience in cabling and circuit design environment Experience dealing with operation and application of electrical components Confidence with use and handling of common measurement instruments Provision of quality customer service when required Knowledge In-depth and thorough knowledge of learning machine methods Core application functionality and application technology stack Strong Office 365 skills: Excel, Word, Visio and Power Point Microsoft technologies such as Microsoft SQL Server, Microsoft Exchange Server, Share Point Portal Server, Microsoft Biz Talk Server Understanding of the Software Development Life Cycle Understanding of the customer's business processes Skills & Abilities Attention to Detail: Must pay attention to detail and be thorough in completing tasks. Troubleshooting: Must be able to examine, test and resolve issues quickly, ensuring quick and proper rectification of problem areas. Decision-making: Must be able to utilize their professional knowledge and make decisions confidently. Adaptability: Must be comfortable working in a dynamic and fast-paced environment, able to adapt quickly to changing circumstances. Integrity: Must demonstrate high ethical standards and integrity in all financial dealings. Initiative: Must be willing to take on responsibilities and challenges. Dependability: Must be reliable, responsible, and dependable in fulfilling obligations. Organisation: Must be able to formulate and maintain system records and system designs. Planning & Time Management: Must be able to plan efficiently and manage time effectively.