Data Engineer, Mission Analytics (Active DOD Clearance Required)
Navaide
- Washington DC
- Permanent
- Full-time
- Build and maintain resilient ETL/ELT pipelines that promote data from raw ingest to curated datasets across staging and production environments.
- Incorporate automation, version control, orchestration, and health monitoring to keep data flows secure, repeatable, and auditable.
- Leverage authoritative (“gold”) data tables across disparate systems — including logistics, personnel, and financial — to create unified, analysis-ready datasets.
- Rapidly learn and interpret unfamiliar data domains to identify appropriate join keys, metadata definitions, and integration strategies.
- Define and enforce warehouse/lake architectural standards for distributed (e.g., Spark/MPP) environments.
- Develop rule-based and scalable methods for assessing data accuracy, completeness, and timeliness.
- Implement feedback loops and data scoring to continuously monitor quality and drive remediation actions.
- Tag and document datasets with lineage, usage, and ownership information to support data discovery and compliance.
- Partner with data stewards and analysts to establish authoritative datasets and ensure traceability of critical business metrics.
- Tune workloads, partitioning, and resource allocation for cost-efficient performance.
- Instrument dashboards and alerts to surface data-latency or pipeline-failure issues against SLAs.
- Partner with analytics and product teams to ensure downstream use cases receive clean, well-documented data.
- Document patterns, mentor peers, and drive best-practice adoption across the engineering community.
- 4+ yrs building production pipelines in cloud data platforms (AWS Databricks highly preferred)
- Proficiency in SQL, Python, and modern data transformation tools or frameworks
- Git-centric DevOps mindset
- Proficiency with Spark or other distributed computing frameworks, and experience with scalable data architectures (e.g., Lakehouse, Delta, MPP engines).
- Familiarity with metadata and cataloging practices; experience with tools like Unity Catalog, Collibra, or equivalents is a plus.
- Experience with data quality frameworks, either commercial or open source (e.g., implementing validation layers, scoring models, alerting)
- Proven delivery inside DoD, Fed IL4/IL5, or alike environments (Advana/Jupiter a plus)
- Strong communication skills and ability to work across technical and non-technical stakeholders.
- Familiarity with USMC or Navy logistics / operational data landscapes
- Competitive compensation and comprehensive benefits, including medical, dental, and vision coverage
- Flexible time off
- Professional development opportunities
- Company perks such as flex spending, wellness initiatives, etc.
- 401(K) matching