Software Engineer II-Big Data/Pyspark

JPMorgan Chase

  • Plano, TX
  • Permanent
  • Full-time
  • 7 days ago
You're ready to gain the skills and experience needed to grow within your role and advance your career - and we have the perfect software engineering opportunity for you.As a Software Engineer II-Big Data/Pyspark at JPMorgan Chase within the Consumer and Community Banking-Customer Identity and Authentication team, you are part of an agile team that works to enhance, design, and deliver the software components of the firm's state-of-the-art technology products in a secure, stable, and scalable way. As an emerging member of a software engineering team, you execute software solutions through the design, development, and technical troubleshooting of multiple components within a technical product, application, or system, while gaining the skills and experience needed to grow within your role.Job responsibilities
  • Design, develop, and maintain scalable data pipelines and ETL processes to support data integration and analytics. Implement ETL transformations on big data platforms, utilizing NoSQL databases like MongoDB, DynamoDB, and Cassandra.
  • Utilize Python for data processing and transformation tasks, ensuring efficient and reliable data workflows. Work hands-on with SPARK to manage and process large datasets efficiently.
  • Implement data orchestration and workflow automation using Apache Airflow. Apply understanding of Event-Driven Architecture (EDA) and Event Streaming, with exposure to Apache Kafka.
  • Use Terraform for infrastructure provisioning and management, ensuring a robust and scalable data infrastructure. Deploy and manage containerized applications using Kubernetes (EKS) and Amazon ECS
  • Implement AWS enterprise solutions, including Redshift, S3, EC2, Data Pipeline, and EMR, to enhance data processing capabilities.
  • Develop and optimize data models to support business intelligence and analytics requirements. Work with graph databases to model and query complex relationships within data.
  • Create and maintain interactive and insightful reports and dashboards using Tableau to support data-driven decision-making.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
Required qualifications, capabilities and skills
  • Formal training or certification on software engineering concepts and 2+ years applied experience
  • Strong programming skills in Python, with basic knowledge of Java
  • Proficiency in data modeling techniques and best practices.
  • Proficiency in understanding of graph databases and experience in modeling and querying graph data
  • Experience in creating reports and dashboards using Tableau
  • Hands-on experience with SPARK and managing large datasets.
  • Experience in implementing ETL transformations on big data platforms, particularly with NoSQL databases (MongoDB, DynamoDB, Cassandra)
  • Proficiency in understanding of Event-Driven Architecture (EDA) and Event Streaming, with exposure to Apache Kafka
Preferred qualifications, capabilities and skills
  • Strong analytical and problem-solving skills, with attention to detail
  • Ability to work independently and collaboratively in a team environment
  • Good communication skills, with the ability to convey technical concepts to non-technical stakeholders
  • A proactive approach to learning and adapting to new technologies and methodologies
  • Experience with Apache Airflow for data orchestration and workflow management
  • Familiarity with container orchestration platforms such as Kubernetes (EKS) and Amazon ECS. Experience with Terraform for infrastructure as code and cloud resource management
  • Familiarity with AWS enterprise implementations such as EMR/Glue, S3, EC2, Data Pipeline, Lambdas and IAM roles
Chase is a leading financial services firm, helping nearly half of America's households and small businesses achieve their financial goals through a broad range of financial products. Our mission is to create engaged, lifelong relationships and put our customers at the heart of everything we do. We also help small businesses, nonprofits and cities grow, delivering solutions to solve all their financial needs.We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.Equal Opportunity Employer/Disability/Veterans

eQuest