Data Engineer
Posted 1
view
Summary
Data Engineer building and automating scalable data pipelines with Python, SQL, and libraries like pandas and BeautifulSoup, using Jenkins/Git CI/CD and cloud platforms AWS S3 and Azure Databricks. Requires 5+ years of experience; role is based in the United Kingdom with cross-timezone team collaboration and mentoring duties.
Job Role: -Data Engineer
Job Location: -United Kingdom
Experience: -5+ Years
Roles & Responsibilities: -
- Design, develop, and maintain scalable data solutions using Python and SQL in enterprise environments.
- Build and automate data pipelines using libraries such as NumPy, pandas, BeautifulSoup, Selenium, and pdfplumber.
- Collaborate with cross-functional teams across multiple locations and time zones.
- Implement CI/CD processes using Jenkins and Git for continuous integration and deployment.
- Work with AWS (S3) and Azure Databricks for cloud-based data management and analytics.
- Deliver projects following Agile and Scrum methodologies.
- Lead and mentor team members to ensure adherence to best practices and quality standards.
Skills & Requirements: -
- 5+ years of hands-on experience in Python scripting and application development.
- Strong proficiency in SQL and PostgreSQL.
- Familiarity with Python-based libraries: NumPy, pandas, BeautifulSoup, Selenium, pdfplumber, Requests, etc.
- Knowledge of DevOps tools: CI/CD, Jenkins, Git.
- Experience with AWS (S3) and Azure Databricks.
- Understanding of Agile/Scrum development processes.
- Excellent leadership, communication, and team coordination skills.