Data Engineer - Freelance
Summary
Build and maintain a ClickHouse-based data warehouse, design ETL pipelines, and optimize SQL queries for financial analytics and BI reporting.
Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field.
Minimum 2-4 years of experience as a Data Engineer, Data Warehouse Engineer, or a similar role.
Hands-on experience building and maintaining analytical databases using ClickHouse.
Requirements
Education & Experience
Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field.
Minimum 2-4 years of experience as a Data Engineer, Data Warehouse Engineer, or a similar role.
Hands-on experience building and maintaining analytical databases using ClickHouse.
Technical Skills
Strong proficiency in advanced SQL for complex analytical queries and performance optimization.
Solid understanding of Data Warehouse architecture, Data Modeling, and dimensional modeling concepts.
Experience with Fact & Dimension tables, Star Schema, Data Mart, ETL/ELT processes, historical data management, and data aggregation.
Strong knowledge of ClickHouse architecture, including MergeTree table engines, partitioning strategies, and ordering keys.
Experience with data ingestion, transformation, cleansing, and validation processes.
Familiarity with database performance tuning, indexing, materialized views, and query optimization techniques.
Experience integrating analytical databases with Business Intelligence tools such as Metabase.
Understanding of data governance, storage optimization, and data retention strategies.
Soft Skills
Strong analytical and problem-solving abilities.
Excellent attention to detail and commitment to data quality.
Effective communication and collaboration skills across technical and business teams.
Able to manage multiple priorities and work independently in a fast-paced environment.
Key Responsibilities
Design, build, and maintain a scalable Data Warehouse using ClickHouse.
Develop data layers, including Raw, Staging, and Business/Mart layers, for analytical reporting.
Process and integrate data from Nexus Data Warehouse and Integration Layer.
Create and maintain ClickHouse databases, tables, views, materialized views, and other database objects.
Perform data transformation, cleansing, and validation to ensure high-quality analytical datasets.
Implement and maintain data models to support Financial Analysis Tools and business reporting.
Write, optimize, and maintain advanced SQL queries for analytical workloads.
Optimize ClickHouse performance through efficient table engines, partitioning, ordering keys, indexing, materialized views, and query tuning.
Define data storage, archival, and retention strategies while maintaining historical data for comparative reporting.
Perform data reconciliation between source systems and ClickHouse to ensure data accuracy and consistency.
Prepare Business/Mart layers that are readily consumable by BI tools such as Metabase.
Support Metabase reporting requirements by troubleshooting and optimizing query performance.
Investigate and resolve issues related to data ingestion, transformation, and database performance.
Collaborate closely with Nexus Developers, Metabase Developers, and Business/Finance Analysts throughout the data lifecycle.
Support ClickHouse deployment and configuration across development, UAT, and production.
How many years' experience do you have as a Data Engineer?