Senior Software Data Engineer
- New York City, NY
- Permanent
- Full-time
Pay Rate: $85 -$90/hr DOETechnical Requirements & Candidate Profile:
Top skills required: Python, PySpark (especially PySpark Streaming), and ideally some Java experience. The role blends software engineering and data engineering, focusing on generalizing data processes for broader team use and self-service. Candidates can come from either a software or data engineering background, as long as they have experience in both areas.Description:
Our Activation team is seeking a highly motivated Senior Software Engineer with a strong technical background who is passionate about building systems to process data at scale that unlocks capabilities across software and data disciplines. This role involves building and maintaining our Activation Data products which serve as the data sharing platform. The role requires expert knowledge of building scalable, fault-tolerant data products to ensure the reliable delivery of both real-time and batch data. Our tech stack includes AWS, Databricks, Snowflake, Airflow, Spark, and languages include Scala, Python, SQL, and Java.Responsibilities:
- Be a part of a team of big data and backend engineers to deliver high value projects
- Participate in organization-wide large-scale programs representing the team and our stakeholders
- Build components of large-scale data platform for real-time and batch processing, and own features of big data applications to fit evolving business needs
- Participate in building next generation service platform on cloud-based big data infrastructure for batch and streaming data applications, and continuously improve performance, scalability and availability
- Participate in code reviews and evangelize best practices.
- Advocate the best engineering practices, including the use of design patterns, CI/CD, code review and automated test
- Mentor and guide the professional and technical development of junior team members
- Collaborate with program managers, product managers, SDET, and researchers in an open and innovative environment
- Minimum of 5 years of related software development experience
- Minimum 5 years' experience with Python, Scala, or Java.
- Minimum 2 years' experience with Spark
- Strong experience with complex SQL development related to extract, transform, and load processes.
- Familiar with Docker and/or containerization technologies.
- Familiar with Airflow or equivalent schedulers.
- Strong software design principles
- Experience mentoring and leading junior engineers.
- Experience collaborating with product managers and program managers across the organization.
- Experience with testing tools, such as pytest, JUnit, or equivalent.
- Experience with QA or QE is a plus
Bachelor's Degree + 5 years of relevant experienceAbout Software Resources
Software Resources, founded more than 3 decades ago, is a trusted staffing partner specializing in Technology (IT, Creative, & Marketing), Finance, & Accounting placements. We work with companies nationwide that need skilled professionals and connect them with candidates like you looking for the right opportunity.
We are always looking for professionals at all experience levels and in various specialties to meet our clients' hiring needs. As a member of our team, you will have access to benefits including medical, dental, and vision coverage, a 401(k) with company match, short-term disability, life insurance with AD&D.
If this position fits interests you, we encourage you to apply. You can view all our job openings at