Data Engineer 2
Posted Updated
Description
Requirements:
- 4+ years of experience in backend engineering, building scalable, reliable, and high-performance systems in production environments.
- Strong proficiency in at least one high-level programming language (Python, Java, or similar) with solid grounding in data structures, algorithms, and problem-solving o Strong working knowledge of SQL, including query optimisation, performance tuning, and working with large-scale datasets.
- Hands-on experience with relational and/or analytical databases (e. g., Snowflake, Redshift, PostgreSQL, MySQL, etc. ), including data modelling and schema design.
- Good understanding of distributed systems fundamentals, including scalability, fault tolerance, and system design.
- Familiarity with cloud platforms (AWS/GCP/Azure) and modern data infrastructure concepts.
- Exposure to data-intensive applications, such as high-throughput APIs, event-driven systems, or analytics platforms.
- Interest in or experience with modern data platforms (e. g., Snowflake) and willingness to quickly learn data engineering tooling and paradigms.
- Basic understanding of security, networking, and production system operations (monitoring, observability, reliability).
- Exposure to or strong interest in GenAI/LLM capabilities (e. g., embeddings, vector search, prompt engineering, or LLM-powered applications) is highly desirable.
- Experience with streaming or real-time systems (Kafka, Kinesis, etc. ) is a plus.
- Experience with data pipeline technologies (Spark, Airflow, etc. ) is a plus.
- Data visualisation skills are a plus (PowerBI, Metabase, Tableau, Hex, Sigma, etc).
- Bachelor's Degree in Computer Science (or equivalent).
- Strong verbal and written communication skills.
Skills
- Airflow
- Analytics
- API
- AWS
- Azure
- Cloud
- Data Engineering
- Data Modeling
- Data Pipelines
- Data Visualization
- Distributed Systems
- Embeddings
- Event Driven Architecture
- GCP
- Generative AI
- Java
- Kafka
- Kinesis
- LLM
- Metabase
- MySQL
- Networking
- Observability
- PostgreSQL
- Power BI
- Prompt Engineering
- Python
- Redshift
- Snowflake
- Spark
- SQL
- Tableau
- Vector Search
