Senior Data Engineer | B2B Cooperation
Summary
Senior Data Engineer at Profitroom to build and own the company's cloud data platform — incremental ELT pipelines, Delta Lakehouse, and data governance — on Databricks, Python/PySpark, GCP/BigQuery, Airflow/Dagster, Docker and Terraform. B2B contract, remote-first collaboration from Poland.
- Maintain and automate our cloud data platform (GCP, Databricks), which powers our reporting suite and internal data systems.
- Manage infrastructure as code with Terraform for GCP and Databricks.
- Build and maintain CI/CD pipelines in GitLab, including Databricks deployments with Asset Bundles.
- Maintain Docker images and runtime environments for Dagster and Airbyte, with zero-downtime upgrades.
- Own development and production environments and the release process.
- Set up observability for the platform and pipelines: alerting, metrics, logs and data freshness monitoring.
- Define SLOs for key pipelines, handle incidents, write runbooks and run postmortems.
- Manage access, IAM, service principals and secrets, following the principle of least privilege.
- Monitor and optimize cloud costs (FinOps) across GCP and Databricks.
- Maintain and support the development of Hermes, our AI analytics environment (deployments, BigQuery datasets, monitoring and tracing in Langfuse).
- Support data lineage, cataloguing and governance with DataHub.
- Work with Data Engineers to run their pipelines reliably in production, and with analysts on data availability, SLAs and self-service access.
- Automate repetitive operational work and help retire legacy tools.
Requirements
What we're looking for
- Infrastructure as Code: Hands-on experience with Terraform.
- CI/CD and containers: Hands-on experience with CI/CD pipelines, Docker and Bash.
- Cloud platforms: Hands-on work in a cloud environment, preferably GCP (IAM, networking, cost management).
- Observability: Experience with monitoring, alerting and handling production incidents.
- Orchestration: Experience operating orchestration tools such as Dagster or Airflow.
- Databricks: Working knowledge of Databricks (jobs, clusters, workspace administration).
- Experience: 3+ years of commercial experience with Python and SQL.
- Deployment: Proficiency with deploying and running production-grade applications.
- Communication: Very good communication skills with the ability to work with both technical and non-technical stakeholders.
- Teamwork: Excellent team player who embraces teamwork and mutual support.
- Languages: Fluency in Polish (C1+) and strong command of English (B2+) required.
- Background: Previous experience in a DevOps, SRE, Platform Engineering or Data Engineering role.
- Databricks tooling: Experience with Databricks Asset Bundles and Unity Catalog.
- Data tooling: Experience with Airbyte, DataHub or ClickHouse.
- LLMOps: Experience running AI/LLM applications in production (e.g. Langfuse).
- Spark: Commercial experience with Spark.
Benefits
What comes with the job
Contract terms: B2B cooperation. Monthly compensation range: 23,000–27,000 PLN, depending on experience and the agreed scope of services.
- Remote-first collaboration model
- International technology and product projects
- Flexible project collaboration setup
- Planned service breaks aligned with contract terms
- Opportunity to collaborate with experienced product and technology teams
- Opportunity to access selected knowledge-sharing initiatives
→ Recruitment process
- Intro call with the Recruiter (up to 45 minutes).
- Technical interview with Hiring Manager and Data Engineer (up to 60 minutes).
- Team fit interview with Hiring Manager and Data Analyst (up to 60 minutes).