Big Data Engineer
Posted Updated
Description
We are looking for an experienced Big Data Engineer with hands-on expertise in Big Data technologies, Python, PySpark, SQL, Linux, and Shell Scripting.
Key Responsibilities
- Develop and maintain scalable data processing pipelines using Python and PySpark.
- Work with large datasets and perform data transformation and processing.
- Write and optimize SQL queries for data extraction and analysis.
- Perform data processing and troubleshooting in Linux environments.
- Develop and maintain Shell scripts for automation and job execution.
- Identify and resolve data pipeline issues and improve performance.
- Collaborate with cross-functional teams to deliver data engineering solutions.
Mandatory Skills
- Big Data
- Python
- PySpark
- SQL
- Linux
- Shell Scripting