Senior Member Technical Staff
Summary
Senior engineer leading the design and implementation of high-throughput data ingestion systems and ETL pipelines using Java, Python, and cloud services, while mentoring a team of engineers.
Key Responsibilities
Technical Leadership: Lead the technical design, architecture, and implementation of high-throughput data ingestion systems and ETL pipelines.
Team Mentorship: Guide, mentor, and elevate a team of Engineers, fostering a culture of technical excellence and best practices.
Hands-on Development: Write clean, scalable, and maintainable code primarily in Java and Python.
Performance Optimization: Proactively monitor and resolve complex issues related to high memory and CPU consumption, bottlenecks in data transfer, and queue processing.
Agile Delivery: Partner with product managers and scrum masters to drive Agile/Scrum ceremonies, sprint planning, and timely delivery of features.
End-to-End Ownership: Oversee the full software development lifecycle, from system design and data formatting/analytics to deployment and infrastructure management.
Technical Requirements
Core Backend & Data Engineering:
Languages: Expert-level proficiency in Java and Python.
Data & Big Data: Deep understanding of Apache Spark, ETL pipeline design, data formatting, and data analytics.
Databases: Strong hands-on experience with both SQL (e.g., PostgreSQL, MySQL) and NoSQL (e.g., DynamoDB, MongoDB, Cassandra) databases.
Messaging/Queues: Proven experience working with message brokers and queues (e.g., Kafka, AWS SQS, RabbitMQ) to manage asynchronous data transfer.
Cloud & Infrastructure:
Cloud Platform: Extensive experience with AWS cloud services (e.g., S3, EC2, EMR, Lambda, RDS).
DevOps & CI/CD: Hands-on experience setting up and managing deployment pipelines using GitLab or Jenkins.
Containerization: Solid understanding and experience deploying applications using Kubernetes (K8s) and Docker.
Infrastructure as Code (IaC): Familiarity with IaC tools (e.g., Terraform, AWS CloudFormation) to provision cloud resources.
Additional Skills:
Frontend/UI: Basic understanding of UI development (HTML, CSS, JavaScript, or modern frameworks) to collaborate effectively with full-stack or frontend teams.
Methodology: Strong practical experience working within and leading Scrum/Agile environments.
7 to 8 years of professional software engineering experience, with at least 1–2 years in a leadership, lead, or architectural capacity.
Proven track record of building and scaling high-volume data ingestion or streaming platforms.
Strong problem-solving skills with a deep understanding of system design, data structures, and algorithms.
Excellent communication skills, with the ability to explain complex technical concepts to both technical and non-technical stakeholders.
Please be aware that job-seekers may be at risk of targeting by scammers seeking personal data or money. Nielsen recruiters will only contact you through official job boards, LinkedIn, or email with a domain. Be cautious of any outreach claiming to be from Nielsen via other messaging platforms or personal email addresses. Always verify that email communications come from an @ address. If you're unsure about the authenticity of a job offer or communication, please contact Nielsen directly through our official website or verified social media channels.