DEVOPS ENGINEER
Summary
Build and maintain AWS serverless pipelines: Glue ETL, Lambda integrations, DynamoDB writes, API Gateway endpoints, and CI/CD with CDK and Git.
Responsibilities
- Operate and optimize Glue ETL pipelines, including initial loads and daily delta processing, and maintain Glue Catalog metadata, schemas, and Parquet structures.
- Ensure accurate delta detection using updated_at logic and manage efficient write operations to DynamoDB, including configuration of DynamoDB Streams, retry handling, DLQs, and throughput tuning.
- Maintain Lambda‑based integrations that distribute EULA changes to downstream systems (iPaaS, GIS, Service Center, internal APIs) and support SQS, EventBridge, or Kafka delivery pipelines, including topic/rule configuration and monitoring.
- Manage REST endpoints in AWS API Gateway used for querying mapping data, including authentication, authorizers, throttling, and optional mTLS.
- Implement secure outbound API calls using mTLS, handling client certificates, Secrets Manager storage, and certificate rotation.
- Operate CI/CD workflows using Git and AWS CDK, and build, test, and deploy Python and Node.js functions used across ETL and integration layers.
- Configure CloudWatch dashboards, alarms, and metrics, and maintain system‑level monitoring for all components.
- Provide operational support, troubleshooting, and incident response during both hypercare and BAU phases.
Qualifications
- Successful completion of higher education as a qualified IT specialist or similar.
- You have min. 2 years as DevOps Engineer
- Strong experience with AWS Serverless services, including Lambda, DynamoDB, EventBridge, SQS, API Gateway, and CloudWatch.
- Solid data engineering skills with AWS Glue (Spark and Python Shell), Glue Catalog, S3 Parquet, and messaging services such as SNS or SES.
- Hands‑on experience with integration technologies such as Kafka (MSK or external), REST APIs, mTLS mutual authentication, and handling pagination.
- Proficiency in Python for ETL and Lambda development, and Node.js for integration logic.
- Practical knowledge of infrastructure‑as‑code and source control using AWS CDK, Git, and CI/CD pipelines.
- Strong understanding of AWS security components including IAM, KMS, Secrets Manager, VPC networking, and certificate management.
- Ability to debug distributed systems, analyze logs, handle DLQ replays, and design effective retry strategies.
- Comfortable collaborating with Data Lake teams, downstream system owners, and governance stakeholders.
- Fluent communication skills in English and Polish.
- Availability to work in a hybrid mode with at least 1 visit in the office per month.