IN_Manager_Databricks_D&A_Advisory_Mumbai
Posted Updated
Description
<p class="mb-2 whitespace-pre-wrap" style="font-family:Inter, sans-serif;margin:0px 0px 1.25em;white-space:pre-wrap;border-width:0px;border-style:solid;border-color:rgb(227,227,227);color:rgb(66,66,66);font-size:16px;"><span style="font-family:Cambria;border-width:0px;border-style:solid;border-color:rgb(227,227,227);font-weight:600;color:rgb(17,24,39);">Job Description & Summary:</span></p><p class="mb-2 whitespace-pre-wrap" style="font-family:Inter, sans-serif;margin:1.25em 0px;white-space:pre-wrap;border-width:0px;border-style:solid;border-color:rgb(227,227,227);color:rgb(66,66,66);font-size:16px;"><span style="font-family:Cambria;">PwC India is looking for a highly skilled Databricks Manager with hands-on experience in designing, developing, and managing scalable big data and analytics solutions using the Databricks platform. This role focuses on deploying, integrating, and optimizing the Databricks ecosystem to enable efficient data processing, advanced analytics, and enterprise-wide data transformation initiatives.</span></p><p class="mb-2 whitespace-pre-wrap" style="font-family:Inter, sans-serif;margin:0px 0px 1.25em;white-space:pre-wrap;border-width:0px;border-style:solid;border-color:rgb(227,227,227);color:rgb(66,66,66);font-size:16px;"><span style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);font-weight:600;color:rgb(17,24,39);"><br /></span></p><p class="mb-2 whitespace-pre-wrap" style="font-family:Inter, sans-serif;margin:0px 0px 1.25em;white-space:pre-wrap;border-width:0px;border-style:solid;border-color:rgb(227,227,227);color:rgb(66,66,66);font-size:16px;"><span style="font-family:Cambria;border-width:0px;border-style:solid;border-color:rgb(227,227,227);font-weight:600;color:rgb(17,24,39);">Job Position Title: </span><span style="font-family:Cambria;">IN_Manager_Databricks_D&A_Advisory_Mumbai</span></p><p class="mb-2 whitespace-pre-wrap" style="font-family:Inter, sans-serif;margin:0px 0px 1.25em;white-space:pre-wrap;border-width:0px;border-style:solid;border-color:rgb(227,227,227);color:rgb(66,66,66);font-size:16px;"><span style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);font-weight:600;color:rgb(17,24,39);"><br /></span></p><p class="mb-2 whitespace-pre-wrap" style="font-family:Inter, sans-serif;margin:0px 0px 1.25em;white-space:pre-wrap;border-width:0px;border-style:solid;border-color:rgb(227,227,227);color:rgb(66,66,66);font-size:16px;"><span style="font-family:Cambria;border-width:0px;border-style:solid;border-color:rgb(227,227,227);font-weight:600;color:rgb(17,24,39);">Responsibilities:</span></p><ul style="font-family:Inter, sans-serif;padding:0px 0px 0px 1em;margin:1em 0px;border-width:0px;border-style:solid;border-color:rgb(227,227,227);list-style:disc outside;color:rgb(66,66,66);font-size:16px;"><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Lead the architecture, design, and implementation of data engineering solutions on the Databricks platform to support big data analytics and AI/ML workloads.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Develop and maintain scalable ETL/ELT pipelines using Apache Spark on Databricks for processing large volumes of structured and unstructured data.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Collaborate with business stakeholders, data scientists, and engineers to translate data requirements into robust, performant Databricks solutions.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Optimize cluster performance, cost, and resource utilization within Databricks environments.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Manage data ingestion, transformation, and integration workflows connecting Databricks with data lakes, data warehouses, and enterprise applications.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Implement data governance, security, and compliance best practices in the Databricks platform.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Oversee monitoring, debugging, and troubleshooting of Databricks applications and data workflows.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Mentor and lead a team of data engineers and analysts, driving best practices in coding, deployment, and operational support.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Create and maintain detailed technical documentation including architecture diagrams, data flow diagrams, and runbooks.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Stay updated with the latest Databricks product features, ecosystem tools, and industry trends to continuously improve solution quality and capabilities.</span></li></ul><p class="mb-2 whitespace-pre-wrap" style="font-family:Inter, sans-serif;margin:0px 0px 1.25em;white-space:pre-wrap;border-width:0px;border-style:solid;border-color:rgb(227,227,227);color:rgb(66,66,66);font-size:16px;"><span style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);font-weight:600;color:rgb(17,24,39);"><br /></span></p><p class="mb-2 whitespace-pre-wrap" style="font-family:Inter, sans-serif;margin:0px 0px 1.25em;white-space:pre-wrap;border-width:0px;border-style:solid;border-color:rgb(227,227,227);color:rgb(66,66,66);font-size:16px;"><span style="font-family:Cambria;border-width:0px;border-style:solid;border-color:rgb(227,227,227);font-weight:600;color:rgb(17,24,39);">Mandatory skill sets:</span></p><ul style="font-family:Inter, sans-serif;padding:0px 0px 0px 1em;margin:1em 0px;border-width:0px;border-style:solid;border-color:rgb(227,227,227);list-style:disc outside;color:rgb(66,66,66);font-size:16px;"><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Extensive hands-on experience with Databricks platform, Apache Spark, and big data processing frameworks.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Strong expertise in building and managing ETL/ELT workflows using Databricks and Spark SQL.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Proficiency in programming languages such as Python, Scala, or SQL for data engineering tasks.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Experience in integrating Databricks with cloud storage (e.g., AWS S3, Azure Data Lake Storage) and data warehouses.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Knowledge of data modeling, data partitioning, and performance optimization techniques in big data environments.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Understanding of data security, encryption, and governance frameworks relevant to cloud data platforms.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Proven leadership experience managing data engineering teams and delivering complex projects on schedule.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Familiarity with version control (Git), CI/CD pipelines, and agile development methodologies.</span></li></ul><p class="mb-2 whitespace-pre-wrap" style="font-family:Inter, sans-serif;margin:0px 0px 1.25em;white-space:pre-wrap;border-width:0px;border-style:solid;border-color:rgb(227,227,227);color:rgb(66,66,66);font-size:16px;"><span style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);font-weight:600;color:rgb(17,24,39);"><br /></span></p><p class="mb-2 whitespace-pre-wrap" style="font-family:Inter, sans-serif;margin:0px 0px 1.25em;white-space:pre-wrap;border-width:0px;border-style:solid;border-color:rgb(227,227,227);color:rgb(66,66,66);font-size:16px;"><span style="font-family:Cambria;border-width:0px;border-style:solid;border-color:rgb(227,227,227);font-weight:600;color:rgb(17,24,39);">Preferred skill sets:</span></p><ul style="font-family:Inter, sans-serif;padding:0px 0px 0px 1em;margin:1em 0px;border-width:0px;border-style:solid;border-color:rgb(227,227,227);list-style:disc outside;color:rgb(66,66,66);font-size:16px;"><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Experience with cloud platforms such as AWS, Azure, or GCP and their respective Databricks offerings.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Knowledge of containerization, orchestration (Docker, Kubernetes), and infrastructure as code (Terraform, ARM).</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Exposure to machine learning workflows and MLflow in Databricks.</span></li><li style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);margin-bottom:0.5em;margin-top:0.5em;padding-left:0.375em;"><span style="font-family:Cambria;">Prior consulting experience delivering enterprise-scale data solutions and transformations.</span></li></ul><p class="mb-2 whitespace-pre-wrap" style="font-family:Inter, sans-serif;margin:0px 0px 1.25em;white-space:pre-wrap;border-width:0px;border-style:solid;border-color:rgb(227,227,227);color:rgb(66,66,66);font-size:16px;"><span style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);font-weight:600;color:rgb(17,24,39);"><br /></span></p><p class="mb-2 whitespace-pre-wrap" style="font-family:Inter, sans-serif;margin:0px 0px 1.25em;white-space:pre-wrap;border-width:0px;border-style:solid;border-color:rgb(227,227,227);color:rgb(66,66,66);font-size:16px;"><span style="font-family:Cambria;border-width:0px;border-style:solid;border-color:rgb(227,227,227);font-weight:600;color:rgb(17,24,39);">Years of experience required: </span><span style="font-family:Cambria;">8 - 12 Years</span></p><p class="mb-2 whitespace-pre-wrap" style="font-family:Inter, sans-serif;margin:0px 0px 1.25em;white-space:pre-wrap;border-width:0px;border-style:solid;border-color:rgb(227,227,227);color:rgb(66,66,66);font-size:16px;"><span style="font-family:DarwinSans, 'Noto Sans Variable';border-width:0px;border-style:solid;border-color:rgb(227,227,227);font-weight:600;color:rgb(17,24,39);"><br /></span></p><p class="mb-2 whitespace-pre-wrap" style="font-family:Inter, sans-serif;margin:0px 0px 1.25em;white-space:pre-wrap;border-width:0px;border-style:solid;border-color:rgb(227,227,227);color:rgb(66,66,66);font-size:16px;"><span style="font-family:Cambria;border-width:0px;border-style:solid;border-color:rgb(227,227,227);font-weight:600;color:rgb(17,24,39);">Education qualification: </span><span style="font-family:Cambria;">BE, B.Tech, MCA, MBA, M.Tech</span></p>