AWS Cloud and Spark Architect

Experience Required

7+ years of experience in Amazon Web Service (AWS) Cloud Computing
10+ years of experience in Development, Design, Architect Implementation, and Analytics Solutions
Hands-on development, design, setup, and development of applications using AWS-Python/PySpark/Cloud
Very strong Spark Architecture/Development knowledge
510 years of experience in Python and PySpark
At least 8+ years of experience on AWS (Glue, S3, Lambda at the minimum)
Candidates need to be very skilled in Python core programming and Spark
Experience in DevOps building pipelines, etc.
Ability to design and demonstrate system architecture with different environments
Hands-on experience in Data Warehousing and SQL
Experience with Pandas
Strong expertise in SQL is required
Solid experience with Git software version control and good understanding of code branching strategies and organization for code reuse
Experience with DevOps & CI/CD tools Jenkins, CloudBees, Please Build, etc.
Proficiency working with large data stores and data sets
Healthcare knowledge is a must
Agile methodology (Jira preferable)

Roles & Responsibilities

Must have capability to understand the current architecture
Architect, design, code, and implement cloud-based Spark applications
Support existing code through enhancement, troubleshooting, and maintenance as per requirements
Maintain consistent practices for source code management in GitHub
Comply with established CI/CD practices, and participate in the creation of new CI/CD methods
Attend daily scrum calls and actively participate in updating/creating user stories and tasks in Jira
Work closely with business analysts
Lead innovation by exploring, investigating, recommending, benchmarking, and implementing data-centric technologies for the platform
Collaborate within a project team to solve complex problems
Lead by example, coaching and mentoring peers, and guiding less experienced team members
Operate as part of the extended management team