Senior Databricks Engineer (Remote)
- Virginia Beach, VA
- $80,205-133,682 per year
- Permanent
- Full-time
- Understanding the domain of the software problem and/or functionality, the interfaces between hardware and software, and the overall software characteristics
- Using programming, scripting, and/or database languages to write the software code
- Supporting software test engineering, DevOps, deployment, maintenance, and evolution activities by correcting programming errors, responding to scope changes, and coding software enhancements •Applying knowledge of software development best practices, including technical design specifications, coding standards, code reviews, source control management, build processes, testing, and operations.
- Experience in lieu of Bachelor’s Degree
- 5+ years of relevant experience with a degree
- 7+ years of relevant experience without a degree
- No specific certification or licensure requirements
- 10+ years developing software solutions.
- Led the technical implementation of one or more solutions with at least 2 other developers.
- Designed and developed ETL solutions using Azure Data Factory and SSIS
- Experienced with loading data to Azure Synapse Analytics – dedicated SQL pool.
- Written PySpark programs to process large datasets on a spark cluster.
- Written C# .Net programs including mocked unit tests.
- Knows how to write automated tests using testing frameworks (unittest/pytest) in Python, with 1+ years' experience.
- Written stored procedures on Microsoft SQL Server or Azure Synapse Analytics databases.
- Experience with the Azure platform: Azure Synapse Analytics, Azure Data Factory, Function Apps, Azure Databricks
- Designed dimensional data models with facts and slowly changing dimensions.
- Written PowerShell scripts
- Used git to manage code and experienced with pull request process.
- Managed code reviews using git and pull requests.
- Created Builds and Releases in Azure DevOps.