
Senior Data Engineer - Remote
- Austin, TX
- $89,900-160,600 per year
- Permanent
- Full-time
- Design, develop, and maintain scalable data/code pipelines using Azure Databricks, Apache Spark, and Scala
- Collaborate with architects, data engineers and business stakeholders to understand data requirements and deliver high-quality data solutions
- Optimize and tune Spark applications for performance and scalability
- Ensure data quality, integrity, and security throughout the data lifecycle
- Implement data processing workflows, ETL processes, and data integration solutions
- Participate in code reviews and provide meaningful feedback to improve code quality
- Understand product architecture, features being built and come up with product improvement ideas and POCs
- Ensure data quality, integrity, and security throughout the data lifecycle
- Troubleshoot and resolve issues related to data processing and pipeline failures
- Participate in product support activities as needed by the team
- Stay updated with the latest industry trends and best practices in big data technologies
- Serves as a resource to others
- Bachelor’s degree in Computer Science or Information Technology
- 5+ years of working experience with Databricks, Spark, Scala, Cloud databases / data warehouse, Azure DeltaLake, Azure DataFactory, CI/CD
- Implementing end to end features and user stories from analysis/design, building of feature, validation and deployment and post deployment support
- Solid understanding of Data modelling, Databases and Data Warehousing concepts
- Understanding of agile methodology
- Experience with Dot NET/C#
- Experience with query optimization techniques
- Solid troubleshooting skills
- Solid written and verbal communication skills working with technical and non-technical audience