Data Engineer
Connsci
- Gaithersburg, MD
- $119,000-145,000 per year
- Permanent
- Full-time
- Design and maintain secure data ingestion pipelines using Azure Data Factory, API Management, and SFTP
- Develop ETL/ELT workflows in Azure Databricks to cleanse, transform, and normalize data across multiple systems
- Implement data quality checks (e.g., Great Expectations) to validate completeness, accuracy, and timeliness.
- Manage data storage in Azure Data Lake Storage Gen2 (bronze/silver/gold architecture) with evidentiary controls (immutability, hashing, lineage).
- Collaborate with Sr. Data Scientists to operationalize anomaly detection rules and risk scoring models.
- Optimize pipelines for performance, scalability, and cost efficiency across DEV, TEST, POC, PROD environments.
- Apply security best practices in alignment with NIST SP 800-53/171
- Troubleshoot pipeline failures, monitor jobs, and ensure compliance reporting readiness.
- Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience).
- At least 5 years of experience in data engineering or ETL development
- At least 2 years of experience with Azure cloud services to include experience with Data Factory, Databricks, ADLS, Synapse/SQL, or similar
- At least 2 years of experience with data modeling and transformation using SQL and PySpark
- 7+ years of experience in data engineering or ETL development in government or other highly regulated industries
- Familiarity with data governance, compliance, and security frameworks (HIPAA, PII, FERPA, CJIS)
- Experience supporting multi-environment deployments and collaborating in cross-functional teams
- Collaboration and Innovation: Work in an environment where collaboration and innovation are key. You'll have the opportunity to contribute to projects that make a real difference for our clients.
- Professional Growth: Be part of a team that values professional development. We offer opportunities for growth and advancement, allowing you to enhance your skills and career.
- Impactful Work: Engage in meaningful work that addresses mission-critical issues and supports organizations in achieving their goals.