AWS Cloud and Spark Architect
Summary
Senior cloud/data architect who architects, designs, codes, and maintains Spark-based data applications on AWS (Glue, S3, Lambda) using Python/PySpark, SQL, and data warehousing. Works in CI/CD pipelines (Jenkins, CloudBees), GitHub, and Agile/Jira for a healthcare-domain project, while mentoring peers.
AWS Cloud and Spark Architect needs 7+ years of experience in Amazon Web Service (AWS) Cloud Computing
AWS Cloud and Spark Architect requires:
7+ years of experience in Amazon Web Service (AWS) Cloud Computing
10+ years of experience in Development, Design, Architect Implementation, and Analytics Solutions
Hands-on development, design, setup, and development of applications using AWS-Python/PySpark/Cloud
Very strong Spark Architecture/Development knowledge
510 years of experience in Python and PySpark
At least 8+ years of experience on AWS (Glue, S3, Lambda at the minimum)
Skilled in Python core programming and Spark
Experience in DevOps building pipelines, etc.
Ability to design and demonstrate system architecture with different environments
Hands-on experience in Data Warehousing and SQL
Experience with Pandas
Strong expertise in SQL is required
Solid experience with Git software version control and good understanding of code branching strategies and organization for code reuse
Experience with DevOps & CI/CD tools Jenkins, CloudBees, Please Build, etc.
Proficiency working with large data stores and data sets
Healthcare knowledge is a must
Agile methodology (Jira preferable)
AWS Cloud and Spark Architect duties:
Must have capability to understand the current architecture
Architect, design, code, and implement cloud-based Spark applications
Support existing code through enhancement, troubleshooting, and maintenance as per requirements
Maintain consistent practices for source code management in GitHub
Comply with established CI/CD practices, and participate in the creation of new CI/CD methods
Attend daily scrum calls and actively participate in updating/creating user stories and tasks in Jira
Work closely with business analysts
Lead innovation by exploring, investigating, recommending, benchmarking, and implementing data-centric technologies for the platform
Collaborate within a project team to solve complex problems
Lead by example, coaching and mentoring peers, and guiding less experienced team members
Operate as part of the extended management team