Senior Data Engineer
Summary
Senior Data Engineer building and analyzing large-volume data pipelines, offered across three skill tracks (full stack, Python/SQL only, or Spark only). Core stack is Google Cloud (DataProc, BigQuery) with SQL, Python, Spark, Airflow, PostgreSQL, Docker, Git, and Bash.
All Skills
Skills:
At least 3 years of experience in software engineering
At least 1 years of experience in data engineering or the broader data science domain
Ability to write elegant and readable SQL
Knowledge of intermediate SQL features such as window functions
Experience with the Google Cloud data stack (esp. DataProc & BigQuery)
Experience PostgreSQL
Experience with Apache Spark, either Scala or PySpark
Hands on experience with Apache Airflow, ideally already has first experience with version 2.0 (or eagerness to learn)
Skilled in writing Pythonic code
Ability to discover data quality issues and perform descriptive analysis on Big Data
Entrepreneurial spirit and know-how to identify opportunities of improvement
Working proficiency and communication skills in verbal and written English
Passion for playing with large volume of data
Docker, Git, Bash
Bonus:
Neo4J or other graph databases
Founded a company, familiar with the process and paperwork
Python/SQL Only
Skills:
At least 3 years of experience in software engineering
At least 1 years of experience in data engineering or the broader data science domain
Ability to write elegant and readable SQL
Knowledge of intermediate SQL features such as window functions
Experience PostgreSQL
Hands on experience with Apache Airflow, ideally already has first experience with version 2.0 (or eagerness to learn)
Skilled in writing Pythonic code
Entrepreneurial spirit and know-how to identify opportunities of improvement
Working proficiency and communication skills in verbal and written English
Passion for playing with large volume of data
Bonus:
Neo4J or other graph databases
Founded a company, familiar with the process and paperwork
Experience with the Google Cloud data stack (esp. DataProc & BigQuery)
Spark Only
Skills:
At least 3 years of experience in data engineering
Experience with the Google Cloud data stack (esp. DataProc)
Experience with Apache Spark, either Scala or PySpark
Ability to discover data quality issues and perform descriptive analysis on Big Data
Entrepreneurial spirit and know-how to identify opportunities of improvement
Working proficiency and communication skills in verbal and written English
Passion for playing with large volume of data
Bonus:
Neo4J or other graph databases
Founded a company, familiar with the process and paperwork
Experience with the Google Cloud data stack (esp. DataProc & BigQuery)
