
Senior Data Platform Engineer
- Atlanta, GA
- Permanent
- Full-time
- Design and implement robust, scalable, and efficient data models and pipelines across cloud-based platforms.
- Develop, optimize, and maintain ETL/ELT pipelines using Azure Data Factory and Databricks.
- Build and orchestrate Databricks Notebooks and Jobs using PySpark, Spark SQL, or Scala Spark.
- Leverage Snowflake features such as SnowPipe, external tables, and Iceberg concepts to implement efficient data ingestion and processing.
- Develop and manage data models, data warehousing solutions, and data integration architectures in Snowflake.
- Implement Azure Functions, Azure WebApps, and Application Insights to support microservices and monitor distributed systems.
- Monitor and optimize cloud performance and cost using Azure Monitor and cost management tools.
- Configure and manage Databricks clusters, including autoscaling, Photon acceleration, and job orchestration.
- Collaborate with cross-functional teams to support data-driven decision-making and analytics use cases.
- Ensure data quality, governance, and security across the data lifecycle
- High School Diploma or GED
- A minimum of 5 years of experience in Database Modeling, Data Platforms and Engineering
- A minimum of 5 years of experience in Databricks and Snowflake
- A minimum of 3 years of experience in Azure Data Factory
- A minimum of 3 years of experience SQL
- Bachelor's Degree