Data Engineer (Fabric, PySpark, Salesforce) - 100% Remote

Conexess

  • Norfolk, VA
  • Permanent
  • Full-time
  • 8 days ago
Data EngineerWe are building a modern data platform in Microsoft Fabric and seeking a Senior/Principal Data Engineer to help design, implement, and scale it. This role is hands-on with pipelines, notebooks, and CI/CD automation, while also playing a key role in architectural decisions and best practices. You will work alongside a team of senior engineers and architects - each bringing expertise in their domain - so collaboration, technical depth, and leadership are equally important.Key Responsibilities
  • Engineering in Microsoft Fabric
  • Develop, optimize, and maintain Fabric Data Pipelines for ingestion from on-prem and cloud sources.
  • Build PySpark notebooks to implement scalable transformations, merges/upserts, and medallion-lakehouse patterns.
  • Ensure reliability and performance in Lakehouse and Delta Lake design.
  • Architecture & Design
  • Contribute to the design and evolution of our Fabric-based platform.
  • Define standards and frameworks for schema management, versioning, governance, and data quality.
  • Collaborate with peers to evaluate trade-offs and guide enterprise-scale architecture.
  • DevOps & CI/CD
  • Build and maintain deployment pipelines for Fabric artifacts (notebooks, pipelines, lakehouses).
  • Establish environment-aware configuration and promotion workflows across Dev/QA/Prod.
  • Drive automation to reduce manual effort and improve reliability.
  • Mentorship
  • Work as a peer-leader with other senior engineers and architects to shape platform strategy.
  • Mentor other engineers and contribute to building a strong engineering culture.
Required Qualifications
  • 7+ years in data engineering, with proven impact in enterprise environments.
  • Strong hands-on expertise in Microsoft Fabric (Pipelines, Lakehouse, Notebooks, OneLake).
  • Advanced PySpark skills for data processing at scale.
  • Expertise in Delta Lake, medallion architecture, schema evolution, and data modeling.
  • Experience with CI/CD for data engineering, including Fabric asset deployments.
  • Strong SQL and experience with SQL Server/Azure SQL.
Preferred Qualifications
  • Experience helping launch or scale Microsoft Fabric adoption.
  • Familiarity with data governance, lineage, and compliance frameworks.
  • Knowledge of real-time/streaming data patterns.
  • Exposure to Salesforce, CRM, or DMS integrations.
  • Excellent communication and collaboration skills for working with peer-level experts.
  • In depth knowledge of the Azure ecosystem (API Management, Azure Functions, etc.).
#LI-RS1
#LI-REMOTE

Conexess