
Data Engineer Senior - Data Products Organization (Hadoop, Spark 3, Python, Kafka)
- USA
- $65,000-149,500 per year
- Permanent
- Full-time
- Proven data literacy skills to describe business outcomes, data uses, data sources, and their management concepts and analytical approaches to all organizational levels in both business and technology.
- Demonstrate initiative to develop approaches to solutions as part of a team
- Review architecture and identify areas for automation, optimization, right-sizing, and cost reduction to support health of the environment.
- Design, build and test data integration processes between business-critical applications to solve complex problems within financial services.
- Define and implement internal process improvements through the development of detailed analytics that provide actionable insights into key business performance metricsSkills
- Extensive experience with data technologies and distributed computing tools (Hadoop, Spark, Hive Kafka, HDFS, Sqoop, Impala, Beeline, CA7 Orchestration)
- Lead experience as a Data Engineer
- Strong proficiency in relevant programming languages such as Python, PySpark, Spark, SQL
- Practical development and application of Kafka streaming and complex orchestration
- Proficient in Containerization (OpenShift, Kubernetes, Docker, etc.)
- Experience with public cloud platforms (prefer AWS and Microsoft Azure)
- Knowledge of Linux
- Knowledge of IceburgPNC will not provide sponsorship for employment visa for this position. PNC will not participate in OPT or STEM OPT for this position.PNC will not provide sponsorship for employment visas or participate in STEM OPT for this position.Job Description
- Leads in developing, supporting and implementing data solutions for multiple applications in order to meet business objectives and user requirements. Leverages technical knowledge and industry experience to design, build and maintain technology solutions.
- Leads data requirement analysis and the data preparation process development for targeted data solutions.
- Leads in designing and building data service infrastructure on multiple data platforms, according the workflow.
- Oversees the development and implementation of data solutions for multiple applications to ensure its scalability, availability and maintainability.
- Consults on data migration and transformation to ensure the accuracy and security of data solutions.
- Customer Focused - Knowledgeable of the values and practices that align customer needs and satisfaction as primary considerations in all business decisions and able to leverage that information in creating customized customer solutions.
- Managing Risk - Assessing and effectively managing all of the risks associated with their business objectives and activities to ensure they adhere to and support PNC's Enterprise Risk Management Framework.