Databricks Data Developer for AI-Driven Pipelines
Posted Updated
Description
CI&T is seeking a Master Data Developer (Databricks) in Colombia to design, develop, and maintain scalable data infrastructures and pipelines. You will implement data architectures, ensure data quality, and collaborate with analytics teams to deliver high-performance data solutions.
The role requires strong experience in Databricks, data migration, and modern data stack technologies, with a focus on security and governance across cloud platforms.
Build and optimize scalable data pipelines and ETL/ELT processes. Implement and optimize data architectures: data lakes, warehouses, integration layers. Ensure data quality, governance, and security across systems. Develop integrations between data sources and analytics platforms. Collaborate with analytics managers to translate requirements into technical solutions. Monitor and optimize pipeline performance and storage costs. Create technical documentation for architectures and processes. Leverage AI tools to enhance data engineering workflows. Hands-on Databricks migration with migration tools and Unity catalog. Experience migrating notebooks and DAG/ETL pipelines. Experience with AWS services: S3, Glue, Secrets Manager, IAM, Athena. Proficiency in Spark SQL, PySpark, Java, Python and Scala. Premium Healthcare Meal voucher Maternity and Parental leaves Mobile services subsidy Sick pay-Life insurance CI&T University Colombian Holidays Paid VacationsSkills
Sign in to read and join the discussion.