Software Engineer 3 - Linux/Bash/Python/Apache Airflow/SQL/Jupyter Notebook/NumPy/JSON
Posted Updated 4
views
Captivation Software Engineer 3 - Linux/Bash/Python/Apache Airflow/SQL/Jupyter Notebook/NumPy/JSON
Summary
Builds and optimizes distributed data pipelines using Python, Apache Spark, Airflow, and SQL; automates workflows with Bash and analyzes data in Jupyter Notebooks.
- Build distributed processing pipelines with Apache Spark
- Design data egress pathways
- Design data ingress pathways
- Develop bash scripts to automate processes
- Implement analytics data processing workflows
- Optimize reliable scalable data processing
- Orchestrate schedule and monitor workflows with Apache Airflow
- Process and query large datasets with SQL
- Use Jupyter Notebook for data analysis
Perks/Benefits:
- 401k contribution
- AD and D insurance
- Dental insurance
- Direct hire only
- HSA contribution
- Health insurance
- Life insurance
- Long-term disability
- Paid time off
- Short-term disability
- Vision insurance