Job OpportunityLocation: Newark, NJ - Hybrid Onsite (Local Candidates Only)Duration: 6 monthsWe are seeking a skilled Data Engineer with expertise in Microsoft Fabric and Azure technologies. This role is pivotal for designing and implementing robust data solutions that empower our analytics and machine learning capabilities.Responsibilities
Design and implement data storage systems using Azure services such as Azure SQL Database, Azure Data Lake Storage, and Azure Synapse, ensuring scalability, performance, and cost-effectiveness.
Develop and implement data integration processes using Azure Data Factory, including extracting, transforming, and loading data into data warehouses or lakes.
Utilize big data technologies like Apache Spark to create data processing workflows and pipelines supporting analytics and machine learning applications.
Build and maintain applications in preparation for a large-scale architectural migration within an Agile environment.
Monitor and optimize data pipelines and database performance to ensure processing efficiency.
Build interfaces to support evolving applications and accommodate new data sources and types.
Document engineering processes, data models, and pipelines to ensure transparency and maintainability.
Qualifications
Bachelor's degree in Computer Science or a related field.
5+ years of experience in building data and analytics platforms focused on Azure solutions.
Expertise in Azure services like Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake.
Proficiency in software development and scripting languages, ETL tools (e.g., SSIS, Azure Data Factory, Power BI Dataflow), and database management (MSSQL, Azure SQL Database, Azure Data Lake Storage, and Azure Synapse).
Knowledge of data modeling and data warehousing concepts.
Excellent problem-solving and troubleshooting abilities with attention to detail and commitment to data accuracy.
Experience with cloud-based data migration.
Strong analytical and problem-solving skills with the ability to conduct root cause analysis and provide viable solutions.
Experience working in an Agile environment with Scrum Master/Product Owner roles.
3+ years of programming experience in Python/Pyspark.
Knowledge of Jira, Confluence, SAFe development methodology, and DevOps.
We are committed to fostering a diverse and inclusive workplace. We welcome applications from all qualified individuals.For immediate consideration, please click APPLY.
