Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

VBeyond Corporation

NewBe an early applicant

Azure Data Engineer

Posted

Description

Job Title: Data Engineer

Location: Mexico (Remote)

Type: Long Term Contract


Must have : - Informatica MDM, Kafka & Databricks


Required skills:


Azure Data Factory (ADF) – Building and managing ETL/ELT pipelines.

Azure Data Lake Storage (ADLS Gen2) – Cloud data storage and management.

PySpark – Large-scale data processing.

Delta Lake – Lakehouse architecture and data management.

Apache Kafka – Real-time data streaming (Azure Event Hubs for Kafka is also acceptable).

Informatica IICS / PowerCenter – ETL and data integration.

Master Data Management (MDM) – Data modeling, match/merge rules, and golden record creation.

SQL


Job Description

• We are seeking an experienced Data Engineer based in Mexico to join our nearshore cloud and data engineering team. In this role, you will architect, build, and maintain both batch and real-time data pipelines alongside Master Data Management (MDM) solutions within an Azure environment to support US-based business operations.

Key Responsibilities:

• Batch & Streaming Pipelines: Design, develop, and optimize scalable ETL/ELT workflows using Azure Databricks, Azure Data Factory, and Informatica, alongside real-time data ingestion pipelines using Apache Kafka.

• Master Data Management (MDM): Implement and maintain MDM workflows, data models, and match/merge logic to establish a reliable single source of truth across enterprise systems.

• Azure Lakehouse Management: Manage and optimize data storage, partitioning, and transformation layers within ADLS Gen2 and Delta Lake to ensure high performance and cost efficiency.

• SQL & Performance Tuning: Write complex SQL queries, perform deep data analysis, and troubleshoot bottlenecks across streaming and batch workloads.

Mandatory Skills:

• Azure Data Ecosystem: Hands-on experience building and managing cloud data solutions using Azure services such as Azure Data Lake Storage (ADLS Gen2), Azure Data Factory (ADF), and Azure Synapse Analytics.

• Databricks & Spark: Strong proficiency in Azure Databricks using PySpark, Spark SQL, and Delta Lake for scalable data processing and lakehouse architecture.

• Real-Time Streaming (Kafka): Practical experience designing, building, and troubleshooting real-time event streaming pipelines using Apache Kafka (or Azure Event Hubs for Kafka).

• Informatica & MDM: Proven experience with Informatica (IICS / PowerCenter) and Master Data Management (MDM) concepts, including data modeling, match/merge rules, and golden record creation.

• Advanced SQL: Expert-level SQL skills for complex querying, data transformation, profiling, and performance tuning across relational and cloud data warehouses.

Desired Skills

• DevOps & Orchestration: Experience with CI/CD pipelines (Azure DevOps, GitHub Actions), Infrastructure as Code (Terraform/ARM), and workflow orchestration tools.

• Programming & Scripting: Proficiency in Python or Scala beyond PySpark for automation, API integrations, and custom data processing.

• Data Governance & Security: Familiarity with Unity Catalog, Microsoft Purview, RBAC security models, and data privacy compliance standards.

• Certifications: Microsoft Certified: Azure Data Engineer Associate, Databricks Certified Data Engineer, or Informatica certifications.

Skills

Apply

See also

Data Engineering jobs by country — openings, pay and top skills →