Python Developer
About the Company: A leading organization focused on innovative data solutions, committed to fostering a collaborative and inclusive work environment.
About the Role: The role involves developing and maintaining data pipelines and ETL/ELT/analytics engineering workflows, including vectorization workflows to support advanced search and retrieval capabilities.
Responsibilities:
- Develop and maintain data pipelines and ETL/ELT/analytics engineering workflows, including vectorization workflows to support advanced search and retrieval capabilities.
- Collaborate with data teams to understand requirements and automate deployment and monitoring.
- Optimize data storage and troubleshoot issues to enhance performance.
Qualifications:
- At least 8 years in software or data engineering with proficiency in Python.
Required Skills:
- Strong experience in unit and integration testing.
- Familiarity with DevOps practices and Agile methodologies.
Preferred Skills:
- Experience with AWS and Kubernetes (K8s).
- Familiarity with data platforms such as Snowflake, Databricks, Apache Spark, Apache Hive, open table formats (Delta Lake, Apache Iceberg), and vector databases.
- Experience with orchestration tools such as Apache Airflow, Dagster, Prefect, and Temporal.
- Familiarity with GitHub workflows and Datadog.
Pay range and compensation package: Competitive salary based on experience and qualifications.
Equal Opportunity Statement: We are committed to diversity and inclusivity in our hiring practices and encourage applications from all qualified individuals.