Senior Data Engineer
Summary
Senior Data Engineer at Soch Tech in Dublin designing and maintaining scalable ETL/ELT pipelines, cloud-native data platforms, and data models for reporting/BI across client environments. Core stack: Python, SQL, cloud platforms (AWS/Azure/GCP), and warehouses like Snowflake, Redshift, and BigQuery.
Soch Tech Limited is seeking an experienced Senior Data Engineer to join our growing technology team. You will work closely with cross-functional teams to build robust data pipelines, optimize data processing frameworks, and ensure the reliability, security, and scalability of enterprise data solutions. You will contribute to architecture decisions and best practices for data engineering and cloud technologies while supporting digital transformation and modernization initiatives across client environments.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT and data integration solutions.
- Build and optimize data pipelines for structured and unstructured data.
- Develop cloud-native data platforms and analytics solutions.
- Design and implement data models for reporting and BI.
- Integrate data from multiple systems, APIs, and third-party applications.
- Ensure data quality, governance, security, and compliance.
- Monitor, troubleshoot, and optimize data processing workflows.
- Collaborate with stakeholders, analysts, and development teams.
Skill & Experience
- 5+ years in Data Engineering, Data Integration, or related roles.
- Strong proficiency in Python and SQL.
- Experience with cloud platforms (AWS, Azure, or GCP).
- Experience with data warehousing (Snowflake, Synapse, Redshift, or BigQuery).
- Strong understanding of distributed systems and data processing frameworks.
- Knowledge of CI/CD, version control, and Infrastructure as Code.
- Excellent communication and stakeholder management skills.
- Preferred: Databricks/Spark/PySpark, Airflow/Prefect, data governance, cloud certifications
Skills
- Airflow
- Analytics
- API
- AWS
- Azure
- BigQuery
- CI/CD
- Cloud
- Cloud Native
- Data Engineering
- Data Governance
- Data Pipelines
- Data Quality
- Data Warehousing
- Databricks
- Distributed Systems
- ELT
- ETL
- GCP
- Infrastructure as Code
- Prefect
- PySpark
- Python
- Redshift
- Snowflake
- Spark
- SQL
- Stakeholder Management
- Version Control