AWS Data Engineer/ Data Bricks/Pyspark
Summary
AWS Data Engineer building and maintaining data pipelines using AWS, Databricks, PySpark, Airflow, and Kafka, with SQL and shell scripting.
Role/Skill- AWS Data Engineer/ Data Bricks/Pyspark
Experience - 5 to 12 Years
Location- Bangalore
JD:
- Experience on AWS clouds and Data bricks,Airflow.
- Experience on Apache Kafka streaming processing and Python/PySpark.
- End to end understanding of Databricks architecture, design, development and implementation.
- Hands-on experience in SQL, PL/SQL, Unix Shell Scripting, Autosys.
- Experience with relational databases such as Oracle, PostgreSQL as well as NoSQL databases
- Data integration techniques and tools including APIs and data streaming
- Strong analytical and problem solving skills, with the ability to identify and resolve issues in data pipelines and systems
- Experience with Agile software development methodology and version control systems like GitHub
- Expertise in Data Modeling and DB design with the skills in performance tuning