BSID Data Engineer
Description
TSMC IT is actively seeking talented Data Platform Engineers to design, develop, and scale next-generation data platforms. This role sits at the intersection of data engineering, software engineering, and site reliability engineering (SRE) — you will build and optimize data pipelines, develop platform services as software products, and ensure they run reliably at scale. We are building a world-class, cloud-native data platform that empowers development teams across the organization to build data-driven applications on top of a reliable, scalable, and well-governed data infrastructure. If you share our enthusiasm for data-driven and AI-empowered solutions, we'd love to hear from you.
1. Design, develop, and maintain scalable data pipelines for batch and real-time processing, and optimize data storage solutions to ensure data quality, reliability, and accessibility.
2. Develop data platform capabilities that enhance BI, AI/ML analytics, and reporting, enabling both human users and AI-powered applications to leverage enterprise data effectively.
3. Design and develop a Semantic Layer service that enables AI Agents and AI-powered applications to discover, understand, and query enterprise data in a consistent and governed manner.
4. Build AI-integrated Data Engineering tools that streamline pipeline development, data transformation, and operational workflows through intelligent automation.
5. Develop and maintain an Internal Developer Platform (IDP) that provides self-service capabilities, standardized toolchains, and intuitive interfaces to improve developer experience.
6. Design well-structured APIs, backend services, and platform components following software engineering best practices, including comprehensive testing. Leverage agentic CLI tools and AI coding assistants to accelerate development and improve team productivity.
7. Apply SRE practices — including capacity planning, incident management, and performance tuning — to ensure reliability and performance of high-throughput query engines and workflow orchestration layers.
8. Define and track SLOs/SLIs for critical platform services, and implement monitoring, alerting, and logging to proactively detect and resolve issues.
9. Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs. Ensure data governance, security, and compliance across the platform.
Requirements
1. Hold a Bachelor's or Master's degree in Computer Science, Information Engineering, or a similar technical field, or possess equivalent practical experience.
2. Demonstrate 4+ years of production-level experience as a Data Engineer, Software Engineer, SRE, or in a similar role focusing on data platform or infrastructure development.
3. Possess a strong understanding of database systems (SQL/NoSQL), data warehousing concepts, data modeling, and schema design.
4. Show proficiency in Python or Java, with a strong emphasis on writing optimized and maintainable code for data processing and platform services.
5. Apply solid software engineering fundamentals, including API design, system design, version control, and code review practices.
6. Exhibit familiarity with DevOps practices, including CI/CD toolchains, quality control processes, and artifact management.
7. Maintain and scale core data infrastructure components (e.g., Airflow, Trino, ClickHouse), with familiarity with DataHub being a plus.
8. Be familiar with SRE principles, including SLOs/SLIs, capacity planning, incident response, and observability stacks (e.g., Prometheus, Grafana, ELK/OpenSearch).
#LI-DNI
Skills
- Accessibility
- Agentic AI
- AI
- Airflow
- Analytics
- API
- Api Design
- Automation
- CI/CD
- CLI
- ClickHouse
- Cloud
- Cloud Native
- Data Engineering
- Data Governance
- Data Modeling
- Data Pipelines
- Data Quality
- Data Warehousing
- Developer Experience
- DevOps
- ELK
- Grafana
- Java
- Machine Learning
- NoSQL
- Observability
- OpenSearch
- Prometheus
- Python
- SQL
- SRE
- Trino
- Version Control
- Workflow Orchestration
Sign in to read and join the discussion.