Data Engineer (Databricks Admin) (Pune)
Posted Updated
Description
Data Engineer (Databricks Admin) (Pune)
Company: InfoCepts
Job Location: Pune, Maharashtra, India
Employment Type: Full-time
Experience Required: 20+ years
Position : Data Engineer (Databricks Admin)
Location: Nagpur, Pune
Type of Employment: Full-Time
Purpose of the Position
Design, develop, support, and drive comprehensive data engineering solutions using Databricks
Info
Cepts is a global leader of end-to-end data and analytics solutions with nearly 20 years experience enabling customers to derive value from a variety of data-driven capabilities. Unique among its peers, Info Cepts operates with the scale of a global consulting firm, yet the expertise of a niche partner.
Key Result Areas and Activities:
Implement enhancements, monitor performance, troubleshoot issues, and deliver continuous support for Databricks jobs in the production workplace and perform access management, cluster management for the same
Conduct unit testing, integration testing, and troubleshooting of ETL processes to ensure data accuracy and reliability
Manage deployment of Databricks ETL processes from development to production
Respond to incidents reported by users or monitoring tools, ensuring swift resolution to minimize downtime
Maintain detailed logs of incidents, resolutions, and troubleshooting steps for knowledge sharing and future reference
Candidate needs to work in rotational shifts (including on-call, morning, afternoon, night and weekends shift) proving round the clock support for keeping the environments running and performing at optimal levels
Essential Skills: :
Experience in working with, Databricks with PySpark, with a strong emphasis on support and troubleshooting in production environments
Experience of Databricks Platform administration
Experience in SQL, data warehousing concepts, and relational databases like Oracle, SQL Server, etc.
Strong understanding of data integration, ETL best practices, and batch processing
Knowledge of incident management tools and methodologies like ServiceNow or Jira
Desirable Skills:
Hands on experience on Informatica PowerCenter
Hands-on experience or knowledge on Alteryx
Good understanding of the CI/CD pipeline
Working experience with GitHub
Experience in working with Job scheduler and workload automation tools like Tidal job scheduler, Control-M, etc.
Familiar with Unix/Linux scripting for automating tasks and managing job failures
Qualification:
5+ years of relevant experience in ETL tools
Bachelor s degree in computer science, engineering, or related field
Demonstrated continued learning through one or more technical certifications or related methods
Relevant experience in Retail domain is a plus
Qualities:
Exceptional problem-solving skills, with the ability to break down issues, identify root causes, and propose solutions
Ability to handle multiple tasks effectively, maintain a professional attitude, and work well in a team
Excellent interpersonal and communication skills, with a customer-focused approach and keen attention to detail
Able to work with cross functional teams and clients in different time zones and in rotational shift
Research focused mindset
Champion efforts to ensure appropriate development best practices and assist with strategy and roadmap development
Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying. .
Skills
Sign in to read and join the discussion.