Software developer
Posted Updated 3
views
Summary
Software developer who builds and optimizes ETL/data pipelines with Databricks, PySpark, and SQL on AWS, using Terraform and GitLab CI/CD, to deliver data distribution services for large healthcare clients in Atlanta.
As a Software Developer, you will be responsible for building and managing efficient data pipelines, working with cloud-based technologies, and supporting data distribution for large healthcare clients. You will collaborate with clients and implementation teams to understand requirements and deliver optimized solutions.
Key Responsibilities
- Build and manage efficient ETL pipelines using Databricks workflows or other orchestration frameworks.
- Work with structured and semi-structured data using PySpark.
- Perform data analysis and mapping to produce client output.
- Build data distribution extracts and scripts.
- Optimize performance of data extract scripts.
- Work with clients and implementation teams to understand data distribution requirements.
Required Qualifications
- Proficient with Python and SQL.
- Experience with Spark SQL.
- Familiarity with AWS services (S3, SQS) or similar cloud platforms.
- Experience with Terraform and GitLab CI/CD.
- Query tuning and performance optimization in SQL and/or SparkSQL.
- Familiarity with data warehousing (Snowflake or similar).
- Experience working for a cloud-based data services provider to large healthcare clients.
Preferred Qualifications
- Experience with procurement software or enterprise resource planning (ERP) systems.
- Familiarity with contract management principles.
- Knowledge of supply chain logistics and inventory management.
- Master of Technology in Data Science & Engineering.