Data Engineer
Summary
Build and maintain data pipelines and ETL processes using Python, Flask, and ORMs like SQLAlchemy to support analytics and ML workflows.
Notice Period: Immediate to 30 Days Preferred
Location: Dubai
Technical skills are as below:
Core Python:
- Should be proficient in the basic concepts and features of the Python language, such handling, etc. You should also be familiar with the built-in data structures and methods, such as lists,tuples, dictionaries, sets, strings, etc
Web Frameworks:
- Should have a sound knowledge of one or more web frameworks that are based on Python, such as P, Flask, Pyramid, etc. These frameworks provide tools and libraries to help you create web applications using Python. You should know how to use the framework& features, such as routing, templating, database integration, authentication, testing, etc
Object Relational Mappers (ORMs):
- Should be able to use ORMs to interact with databases using Python objects. ORMs abstract away the low-level SQL queries and provide a high-level interface to manipulate data. Some popular ORMs for Python are SQLAlchemy, Django ORM, Peewee, etc. You should know how to define models, perform CRUD operations, query data, handle transactions,etc
Data Science and Machine Learning:
- Should have some skills in data science and machine learning, as these are some of the most common use cases for Python. You should be able to use libraries and frameworks such as NumPy, Pandas, SciPy, Scikit-learn, TensorFlow, PyTorch, etc. to perform data analysis, manipulation, visualization, and modeling. You should also have a good understanding of the basic concepts and algorithms of statistics, machine learning, and deep learning
Other Skills:
- Debugging and testing: Should be able to use tools and techniques to find and fix errors in your code, such as logging, breakpoints, unit testing, integration testing, etc
- Version control: Should be able to use version control systems, such as Git, to manage your code and collaborate with other developers. You should know how to create branches, commit changes, merge conflicts, push and pull requests, etc
- Communication and teamwork: Should be able to communicate effectively with your clients, stakeholders, and colleagues, and work well in a team. You should be able to write clear and concise documentation, follow coding standards and best practices, give and receive feedback, etc