Senior Developer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Data Bricks and PySpark.
• Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions on time.
• Develop complex data models and ETL processes to extract insights from various sources into a centralized Data Lakehouse.
• Troubleshoot issues related to data quality, performance, and scalability in the pipeline.
• Design scalable Lakehouse solutions, optimize Spark workloads, build medallion architectures, mentor junior team members, and interact with customers.
  

Job Requirements :

• 3-8 years of experience in software development with expertise in Big Data technologies such as Data Bricks and PySpark.
• Strong understanding of data modeling concepts and ability to design efficient ETL processes.
• Experience working with cloud-based platforms like AWS or Azure for deploying big data applications.