Business Analyst (Application Developer)
Posted Updated
Description
Senior Data Engineer with 5+ years of experience designing and delivering production-grade ETL/ELT pipelines and data processing solutions, with strong expertise in commodity trading and market data. Hands-on experience working with SQL, Python, PySpark, Apache Spark, Apache Airflow, AWS Glue, Databricks, Amazon S3, Aurora, and MinIO to build scalable and reliable data platforms. Experienced in processing commodity demand, supply, pricing, stocks, imports, exports, and trade data for downstream analytics and business intelligence. Strong background in distributed data processing, complex SQL transformations, data quality, pipeline orchestration, and cloud-native data engineering. Proven ability to troubleshoot production pipelines, optimize large-scale batch workloads, and deliver reliable data solutions in fast-paced environments