Data Engineer
Edmunds
- Santa Monica, CA
- $109,900-191,815 per year
- Permanent
- Full-time
- Create and maintain scalable, maintainable and reliable data pipelines that process very large quantities of structured and unstructured data in both batch and real time.
- Enhance and maintain the data lakehouse that powers the core of the company's decision making process.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Collaborate with team members with a goal of improving personal knowledge of the systems, ensuring that code changes meet business goals and technology best practices.
- Regularly interact and collaborate with colleagues across functions and teams.
- Work with stakeholders including the Executive, Product, and Data teams to assist with data-related technical issues and support their data infrastructure needs.
- Excellent problem solving, troubleshooting, and communication skills especially in a hybrid and remote environment.
- Desire to learn new technologies.
- Demonstrated ability to design and write maintainable software.
- Understanding of software engineering best practices, object oriented analysis & design, and design patterns & algorithms.
- Experience enhancing and evolving existing systems.
- Almost all of our codebase is in Scala and Python, but we only require that you have a high proficiency in at least one object oriented or functional programming language.
- A strong candidate will also have:
- Experience writing ETL Jobs and working with data at scale.
- Experience writing and maintaining real time / streaming data pipelines.
- Familiarity with some of the following: Spark, Scala, Python, AWS, Databricks, Airflow.
- Fluency in SQL
- Other nice to haves: Kubernetes, Machine Learning.
- Flexible time off
- 13 Paid Holidays
- Comprehensive Health Benefits (medical, dental, vision, life and disability)
- Flexible Spending Accounts (Employees) and Health Savings Accounts (Employee and Employer Contributions)
- 401K Plan with company matching at 100%, up to 6% of eligible salary with immediate vesting
- Stock purchase program
- CarMax vehicle discount
- Up to 4 months Paid Parental Leave
- HeartCash matches employee donations to the causes that are important to them
- 2 Days of Paid Time Off for time to dedicate to social impact causes
- FitCash covers a portion of gym or fitness activity fees
- Well being sessions and events such as yoga, meditation and walking challenges
- On-going career development sessions and an annual learning event
- Pet insurance
- Sabbatical leave
- Education Reimbursement
- Pre-tax spending accounts for qualified transportation expenses
- Plus a coffee bar, frozen yogurt and more!