Data Engineer DevOps
Summary
Build and optimize data pipelines for semiconductor manufacturing using AWS, PySpark, Redshift, and Python to support analytics and AI initiatives across global fabs.
- Assist in understanding the business case and contribute to translating it into a technical solution involving AWS Cloud Services, PySpark, EMR, Python, and Cloud DB Redshift / Postgres.
- Learn and assist with PL/SQL development for high-volume datasets.
- Support the preparation of data warehouse design artifacts based on given requirements (ETL framework design, data modeling, source-target-mapping), and assist with DB query monitoring for tuning and optimization opportunities.
- Demonstrated academic or project-based experience with complex database projects and high-volume data environments.
- Possess foundational problem-solving skills; familiarity with various root cause analysis methods; and the ability to document identified problems and determined resolutions.
- Contribute ideas and recommendations regarding enhancements and/or improvements to existing systems.
- Learn to provide appropriate input on database management standards and assist with monitoring transaction activity and utilization.
- Assist with performance issues analysis and tuning.
- Contribute to data warehouse design and development, including logical and physical schema design.
- Bachelor's Degree in Computer Science
- Demonstration of project management skills, the ability to innovate and execute solutions that matter; the ability to navigate ambiguity.
- Profiles with prior internship/project experience in the relevant field will be an advantage
- Able to work independently, with good communication skills and effective teamwork
- Familiarity with or academic exposure to AWS Services, Big Data concepts, PySpark, Python, and Cloud DB Redshift.
- Data Warehousing Concepts: Foundational knowledge of data warehouse architecture, trends, and design approaches, including Dimensional Modeling and ERD design.
- Documentation and Flow Mapping: Strong conceptual understanding with solid technical documentation skills, particularly the ability to document data flows within business processes.