GCP Data Engineer
Summary
Data engineer at Capco (a Wipro consulting firm) designing, building, and supporting large-scale batch and streaming data pipelines on Google Cloud for banking and financial services clients. Core stack includes BigQuery, Dataflow, Pub/Sub, Cloud Composer, Kafka, Python/SQL, Spark, Docker/Kubernetes, and CI/CD tooling.
Job Title: GCP Data Engineer
About Us
“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery.
WHY JOIN CAPCO?
You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.
MAKE AN IMPACT
Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.
#BEYOURSELFATWORK
Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.
CAREER ADVANCEMENT
With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.
DIVERSITY & INCLUSION
We believe that diversity of people and perspective gives us a competitive advantage.
Location - Bangalore , Hyderabad , Chennai
- Min 8-12 years of hands-on experience in GCP Data Engineering designing, building and supporting distributed systems and large-scale data processing systems in production with a proven track record.
- Expertise in GCP Data Products e.g. BigQuery, Dataflow, Cloud Storage, Pub/Sub, and Cloud Composer, Apache Kafka
- Good hands on experience to Build Batch Data and Streaming Data Pipelines on Google Cloud
- Strong coding/scripting experience developed in a commercial/industry setting (Python, SQL, Java, Scala or Go). Strong SQL ability to write complex queries is must;
- Strong working experience with operational data stores, data warehouse, big data technologies and data lakes
- Experience in using distributed frameworks (Spark, Flink, Beam, Hadoop)
- Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS.
- Experience working with (Real Time streaming), such as Kafka technologies.
- Experience and knowledge of automation and CI/CD – Jenkins, GitHub & Spinnaker.
- Clear understanding of data structures, algorithms, software design, design patterns and core programming concepts.
- Competent in client handling and lead the feature team to deliver outcome;
And any experience of these would be really useful:
- Certification in GCP “Cloud Architect”, “Cloud Developer”, “Professional Data Engineer”
Certification in Apache Kafka (CCDAK)
Skills
As published by greenhouse · 9 questions · 1 written answer
Basics
First Name, Last Name, Email, Phone, Resume/CV, Location
Short answers (8)
- How many years of experience you have in GCP?
- What is your official notice period? If you are serving notice, please mention official last working day.
- Current Location?
- What is your total years of experience ?
- Current CTC ?
- Expected CTC ?
- Have you worked with Kafka or Pub/Sub for real-time streaming?
- Do you hold any offers in hand?
Written answers (1)
- Which programming language do you use for data engineering?