Data Engineer - Python / Big Data

<p class="MsoNormal" style="margin-bottom:0in;"><font color="#000000"><b><span style="font-family:Calibri;font-size:18px;">Job Title: </span></b><span style="font-family:Calibri;font-size:18px;">Data Engineer - Python / Big Data</span></font></p><p></p><p class="MsoNormal" style="margin-bottom:0in;"></p><p><span style="font-family:Calibri;"><font color="#000000"> </font></span></p><p class="MsoNormal" style="margin-bottom:0in;"><b><span style="font-family:Calibri;font-size:18px;"><font color="#000000">About the Role</font></span></b></p><p><font color="#000000"><b></b></font></p><font color="#000000"><b></b></font><p class="MsoNormal" style="margin-bottom:0in;text-align:justify;"><span style="font-family:Calibri;"><font color="#000000">We are looking for a skilled Data Engineer – Python / Big Data to design, build, and optimize scalable, high-performance data systems in cloud environments. In this role, you will be responsible for developing robust data pipelines, managing data infrastructure, and enabling reliable, high-quality data availability for analytics, product, and business teams.</font></span></p><p></p><p class="MsoNormal" style="margin-bottom:0in;text-align:justify;"><span style="font-family:Calibri;"><font color="#000000">You will work closely with cross-functional teams to build scalable data products such as data lakes, data warehouses, and real-time data systems that power critical business decisions.</font></span></p><p></p><p class="MsoNormal" style="margin-bottom:0in;"></p><p><span style="font-family:Calibri;"><font color="#000000"> </font></span></p><p class="MsoNormal" style="margin-bottom:0in;"><b><span style="font-family:Calibri;font-size:18px;"><font color="#000000">What You’ll Do</font></span></b></p><p><font color="#000000"><b></b></font></p><font color="#000000"><b></b></font><p class="MsoNormal" style="margin-bottom:0in;"><b><span style="font-family:Calibri;"><font color="#000000">Data Engineering & Platform Development</font></span></b></p><p><font color="#000000"><b></b></font></p><font color="#000000"><b></b></font><ul style="margin-top:0in;" type="disc"><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Design, develop, and maintain scalable data products including data warehouses, data lakes, and databases </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Build and optimize ETL/ELT pipelines for batch and real-time data processing </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Develop robust and reusable data models to support analytics and reporting needs </font></span><p></p></li></ul><p class="MsoNormal" style="margin-bottom:0in;"><b><span style="font-family:Calibri;"><font color="#000000">Pipeline Development & Optimization</font></span></b></p><p><font color="#000000"><b></b></font></p><font color="#000000"><b></b></font><ul style="margin-top:0in;" type="disc"><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Build and maintain automated, scalable data pipelines </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Monitor, troubleshoot, and optimize pipeline performance for latency, cost, and reliability </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Ensure high availability and data integrity across systems </font></span><p></p></li></ul><p class="MsoNormal" style="margin-bottom:0in;"><b><span style="font-family:Calibri;"><font color="#000000">Cloud & Big Data Engineering</font></span></b></p><p><font color="#000000"><b></b></font></p><font color="#000000"><b></b></font><ul style="margin-top:0in;" type="disc"><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Work with AWS services including EC2, S3, Lambda, Redshift, Glue, EMR, and DynamoDB </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Implement distributed data processing solutions using Spark, Flink, or Kafka </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Design cloud-native data architectures for scalability and efficiency </font></span><p></p></li></ul><p class="MsoNormal" style="margin-bottom:0in;"><b><span style="font-family:Calibri;"><font color="#000000">Technical Leadership & Collaboration</font></span></b></p><p><font color="#000000"><b></b></font></p><font color="#000000"><b></b></font><ul style="margin-top:0in;" type="disc"><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Provide technical guidance on data architecture and engineering best practices </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Collaborate with data scientists, analysts, and engineering teams to deliver data-driven solutions </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Contribute to CI/CD processes and engineering automation </font></span><p></p></li></ul><p class="MsoNormal" style="margin-bottom:0in;"><b><span style="font-family:Calibri;"><font color="#000000">Data Quality & Governance</font></span></b></p><p><font color="#000000"><b></b></font></p><font color="#000000"><b></b></font><ul style="margin-top:0in;" type="disc"><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Ensure accuracy, consistency, and reliability of data systems </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Implement data validation and monitoring frameworks </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Support secure and compliant data handling practices </font></span><p></p></li></ul><p class="MsoNormal" style="margin-bottom:0in;"></p><p><span style="font-family:Calibri;"><font color="#000000"> </font></span></p><p class="MsoNormal" style="margin-bottom:0in;"><b><span style="font-family:Calibri;font-size:18px;"><font color="#000000">What We’re Looking For</font></span></b></p><p><font color="#000000"><b></b></font></p><font color="#000000"><b></b></font><p class="MsoNormal" style="margin-bottom:0in;"><b><span style="font-family:Calibri;"><font color="#000000">Technical Expertise</font></span></b></p><p><font color="#000000"><b></b></font></p><font color="#000000"><b></b></font><ul style="margin-top:0in;" type="disc"><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">3+ years of experience in data engineering, preferably in cloud and big data environments </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Strong proficiency in Python and SQL (MySQL preferred) </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Hands-on experience with ETL/ELT pipelines and data modeling </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Strong understanding of scalable data architectures and distributed systems </font></span><p></p></li></ul><p class="MsoNormal" style="margin-bottom:0in;"><b><span style="font-family:Calibri;"><font color="#000000">Big Data & Cloud Skills</font></span></b></p><p><font color="#000000"><b></b></font></p><font color="#000000"><b></b></font><ul style="margin-top:0in;" type="disc"><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Experience with AWS cloud services (EC2, S3, Lambda, Redshift, Glue, EMR, DynamoDB) </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Hands-on experience with Spark, Kafka, Flink, or similar distributed processing tools </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Familiarity with real-time and batch data processing systems </font></span><p></p></li></ul><p class="MsoNormal" style="margin-bottom:0in;"><b><span style="font-family:Calibri;"><font color="#000000">Engineering Practices</font></span></b></p><p><font color="#000000"><b></b></font></p><font color="#000000"><b></b></font><ul style="margin-top:0in;" type="disc"><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Experience with Git-based version control systems </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Understanding of CI/CD pipelines and deployment automation </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Strong debugging and performance optimization skills </font></span><p></p></li></ul><p class="MsoNormal" style="margin-bottom:0in;"><b><span style="font-family:Calibri;"><font color="#000000">Education</font></span></b></p><p><font color="#000000"><b></b></font></p><font color="#000000"><b></b></font><ul style="margin-top:0in;" type="disc"><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">BE / BTech in Computer Science or related field </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">MCA graduates also eligible </font></span><p></p></li></ul><p class="MsoNormal" style="margin-bottom:0in;"><b><span style="font-family:Calibri;"><font color="#000000">Soft Skills</font></span></b></p><p><font color="#000000"><b></b></font></p><font color="#000000"><b></b></font><ul style="margin-top:0in;" type="disc"><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Strong analytical and problem-solving mindset </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Excellent communication and collaboration skills </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Ability to manage multiple priorities in a fast-paced environment </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Strong attention to detail and quality-focused approach </font></span><p></p></li></ul><p class="MsoNormal" style="margin-bottom:0in;"></p><p><span style="font-family:Calibri;"><font color="#000000"> </font></span></p><p class="MsoNormal" style="margin-bottom:0in;"><b><span style="font-family:Calibri;font-size:18px;"><font color="#000000">Nice to Have</font></span></b></p><p><font color="#000000"><b></b></font></p><font color="#000000"><b></b></font><ul style="margin-top:0in;" type="disc"><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Experience in fintech or high-scale consumer platforms </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Exposure to data governance or data quality frameworks </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Familiarity with orchestration tools like Airflow or similar </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Experience working in startup or product-based environments </font></span><p></p></li></ul><p class="MsoNormal" style="margin-bottom:0in;"></p><p><span style="font-family:Calibri;"><font color="#000000"> </font></span></p><p class="MsoNormal" style="margin-bottom:0in;"><b><span style="font-family:Calibri;font-size:18px;"><font color="#000000">Why You’ll Love Working With Us</font></span></b></p><p><font color="#000000"><b></b></font></p><font color="#000000"><b></b></font><ul style="margin-top:0in;" type="disc"><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Opportunity to build large-scale, high-impact data systems </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Work on modern cloud and big data technologies </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Fast-paced and collaborative engineering culture </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Strong ownership and learning opportunities </font></span><p></p></li><li class="MsoNormal" style="margin-bottom:0in;"><span style="font-family:Calibri;"><font color="#000000">Exposure to real-time, high-volume data platforms </font></span><p></p></li></ul><p class="MsoNormal" style="margin-bottom:0in;"></p><p><span style="font-family:Calibri;"><font color="#000000"> </font></span></p><p class="MsoNormal" style="margin-bottom:0in;"><b><span style="font-family:Calibri;font-size:18px;"><font color="#000000">Role Details</font></span></b></p><p><font color="#000000"><b></b></font></p><font color="#000000"><b></b></font><p class="MsoNormal" style="margin-bottom:0in;"><font color="#000000"><b><span style="font-family:Calibri;">Position:</span></b><span style="font-family:Calibri;"> Data Engineer - Python / Big Data</span><br /><b><span style="font-family:Calibri;">Employment Type:</span></b><span style="font-family:Calibri;"> Full-Time</span><br /><b><span style="font-family:Calibri;">Experience Level:</span></b><span style="font-family:Calibri;"> Mid-Level</span><br /><b><span style="font-family:Calibri;">Location:</span></b><span style="font-family:Calibri;"> Bengaluru, India (Onsite)</span></font></p><p></p><p class="MsoNormal" style="margin-bottom:0in;"></p><p><span style="font-family:Calibri;"><font color="#000000"> </font></span></p><p class="MsoNormal"></p><h2 style="line-height:1.2;"><span style="font-weight:bolder;"><span style="font-family:Calibri;font-size:14px;"><font color="#000000">Recruitment Fraud Warning & Disclaimer</font></span></span></h2><p class="isSelectedEnd" style="line-height:1.2;"><span style="font-family:Calibri;"><font color="#000000">KreditBee is committed to maintaining a transparent, fair, and secure recruitment process. We have become aware of fraudulent individuals and entities falsely claiming to represent KreditBee and offering fake employment opportunities.</font></span></p><p class="isSelectedEnd" style="line-height:1.2;"><span style="font-family:Calibri;"><font color="#000000">Please note that KreditBee never asks candidates to pay any money for registration, training, certifications, security deposits, or any other purpose at any stage of the recruitment process. All official recruitment communications are sent through verified company email domains, primarily @kreditbee.in, @krazybee.com, and @kbnbfc.in. Candidates are advised to verify the sender's email address before responding to any recruitment-related communication. KreditBee does not conduct recruitment through unofficial email addresses or request payments.</font></span></p><p class="isSelectedEnd" style="line-height:1.2;"><font color="#000000"><span style="font-family:Calibri;">If you receive a suspicious job offer, interview invitation, or recruitment-related communication claiming to be from KreditBee, do not make any payment or share sensitive personal or financial information. We encourage you to verify the authenticity of the communication through our official careers page or by contacting us at </span><a href="mailto:hr@kreditbee.in"><span style="font-family:Calibri;">hr@kreditbee.in</span></a><span style="font-family:Calibri;">.</span></font></p><p class="isSelectedEnd" style="line-height:1.2;"><font color="#000000"><span style="font-weight:bolder;"><span style="font-family:Calibri;">Disclaimer:</span></span><span style="font-family:Calibri;"> KreditBee shall not be responsible for any loss, damage, or claims arising from fraudulent job offers or recruitment communications made by unauthorized individuals or entities falsely representing the company. Candidates should exercise due diligence and verify the authenticity of all recruitment-related communications before taking any action.</span></font></p><p class="isSelectedEnd" style="line-height:1.2;"><span style="font-family:Calibri;"><font color="#000000">This job description is intended to outline the general nature and key responsibilities of the position. It is not intended to be an exhaustive list of all duties, responsibilities, or qualifications associated with the role. The responsibilities and qualifications described may be subject to change, and other duties may be assigned as needed. Employment is at-will, meaning the employee or the employer may terminate the employment relationship at any time, with or without cause, and with or without notice.</font></span></p><h2 style="line-height:1.2;"><span style="font-weight:bolder;"><span style="font-family:Calibri;font-size:14px;"><font color="#000000">Data Utilization Disclaimer</font></span></span></h2><p style="line-height:1.2;"><font color="#000000"><span style="font-family:Calibri;">By applying for this position, you acknowledge and agree that any personal data you provide may be used for recruitment and employment purposes. The data collected will be stored and processed in accordance with our privacy policy and applicable data protection laws. Your information will only be shared with relevant internal stakeholders and will not be disclosed to third parties without your consent, unless required by law.</span><span style="font-family:Calibri;"> </span></font></p><p class="MsoNormal"><br /></p><p><b></b></p><b></b>