The RoleResponsibilities:Design and develop end-to-end data architecture on Azure Cloud, including data ingestion, storage, processing, and analytics solutions.Lead the deployment of Databricks environments and integrate them seamlessly with other Azure services.Collaborate with stakeholders to gather requirements and translate them into architectural designs.Ensure data security, privacy, and compliance standards are met within the architecture.Optimize data workflows and pipelines for performance and cost-efficiency.Provide technical guidance and mentorship to development teams.Keep abreast of the latest Azure and Databricks technologies and incorporate best practices.Requirements:Extensive experience designing and implementing data architectures on Azure Cloud.Deep understanding of Databricks platform and its integration with Azure services.Strong knowledge of data warehousing, data lakes, and real-time streaming solutions.Proficiency in SQL, Python, Scala, or Spark.Experience with Azure Data Factory, Azure Data Lake, Azure SQL, and Azure Synapse Analytics.Solid understanding of security, governance, and compliance in cloud data solutions.Preferred, but not required:Experience working in the financial services domain.Knowledge of machine learning and AI integration within data platforms.Familiarity with other cloud platforms like AWS or GCP.Certifications such as Azure Solutions Architect Expert, Azure Data Engineer, or DatabricksCertifications:Azure Solutions Architect ExpertAzure Data Engineer AssociateDatabricks Certification (Certified Data Engineer or similar)
