Lead Data Engineer, Databricks

Delaware North

  • Buffalo, NY
  • $95,900-129,400 per year
  • Permanent
  • Full-time
  • 14 days ago
The OpportunityDelaware North is hiring a Lead Databricks Engineer to join our IT team in Buffalo, New York. As a Lead Databricks Engineer, you will be responsible for leading the development and optimization of our Databricks-based data processing and analytics platform. You will work closely with business stakeholders to design, implement, and maintain scalable and efficient data pipelines, as well as to advance our capabilities in data analysis, machine learning and AI-driven applications.Buffalo, New York location, hybrid in office 2-3 days/week onsite.Relocation assistance available.PayMinimum – Anticipated Maximum Base Salary: $95900 - $129400 / yearIn addition to base salary, we offer an annual bonus plan based on company and individual performance, or a role-based, uncapped sales incentive plan. The advertised pay range represents what we believe at the time of this job posting, that we would be willing to pay for this position. Only in special circumstances, where a candidate has education, training, or experience that far exceeds the requirements for the position, would we consider paying higher than the stated range. Information on our comprehensive benefits package can be found at .BenefitsAt Delaware North, we care about our team members' personal and professional journeys. These are just some of the benefits we offer:
  • Medical, dental, and vision insurance
  • 401(k) with up to 4% company match
  • Annual performance bonus based on level, as well as individual, company, and location performance
  • Paid vacation days and holidays
  • Paid parental bonding leave
  • Tuition and/or professional certification reimbursement
  • Generous friends-and-family discounts at many of our hotels and resorts
Responsibilities
  • Architect and optimize data pipelines for performance and cost-efficiency within the Databricks environment
  • Design and implement ETL processes using Databricks jobs to process and transform raw data into a usable format for analysis
  • Develop and optimize Spark jobs for data processing, analysis, and machine learning tasks
  • Pinpoint and resolve efficiency issues, enhancing the speed of data processing and optimizing the use of resources
  • Establish and uphold security protocols to safeguard confidential data, aligning with applicable Legal and CyberSecurity standards
Qualifications
  • Bachelor's degree in computer science, engineering, or a similar STEM related field
  • Minimum of 5 years of experience in data engineering with a strong focus on Databricks
  • Experience designing and implenting ETL processes using Databricks.
  • Deep understanding of Apache Spark, Delta Lake, and related big data technologies, and proficiency in modern programming languages such as Python and Scala
  • Strong knowledge of SQL and experience with relational, NoSQL, Data Warehouse, and Data Lake methodologies
  • Experience with version control systems, SDLC best practices, Agile methodologies, and cloud architecture, AWS preferred
  • Experience with Spark jobs for data processing, analysis, and machine learning tasks using Databricks.
  • Must be legally authorized to work in the US without sponsorship.
#LI-HybridWho We AreAt Delaware North, you’ll love where you work, who you work with, and how your day unfolds. Whether it’s in sporting venues, casinos, airports, national parks, iconic hotels, or premier restaurants, there’s no telling where your career can ultimately take you. We empower you to do great work in a company with 100 years of success, stability and growth. If you have drive and enjoy the thrill of making things happen - share our vision and grow with us.Delaware North Companies, Incorporated and its subsidiaries consider applicants for all positions without regard to race, color, religion, creed, gender, national origin, age, disability, marital or veteran status, sexual orientation, or any other legally protected status. Delaware North is an equal opportunity employer.

Delaware North