Data Engineer
- Marietta, GA
- Permanent
- Full-time
JOB DESCRIPTIONThis Client Enterprise Business & Digital Transformation (EBDT) Data Engineer position will be in the EBDT Innovation and Technology Solutions (ITS) organization. As a Data Engineer, you will be responsible for the development, optimization, and management of data ingestion, transformation, and storage processes using modern frameworks. The successful candidate will implement infrastructure-as-code and automation solutions to streamline and build resiliency into data processing workflows. You will work closely with our data science and analytics teams to create and optimize data and machine learning models that support stakeholder needs.The responsibilities of this position include, but are not limited to:
- Design, build, and maintain large-scale data systems, including data warehouses, data lakes, and data pipelines
- Develop and implement data architectures that meet the needs of our business stakeholders
- Collaborate with data scientists and analysts to develop and deploy machine learning models and data products
- Ensure data quality, security, and compliance with standards
- Develop and maintain technical documentation of data systems and architectures
- Troubleshoot and resolve data-related issues and optimize system performance
- Develop and implement automated testing and deployment scripts to ensure smooth and efficient delivery of data solutions
- Collaborate with cross-functional teams to identify and prioritize data requirements and develop solutions to meet business needs
- Bachelor's degree in Computer Science, Information Technology, or related field
- 6+ years of experience in data engineering, software development, or a related field
- Experience programming in languages such as Python and Terraform
- Experience with data architecture, data modelling, and data warehousing concepts
- Experience with data pipeline tools such as Apache Spark, Apache Kafka, AWS Kinesis
- Understanding of data security and compliance principles and practices
- Excellent problem-solving skills, with the ability to analyse complex data systems and identify areas for improvement
- Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams
- Experience with Artificial Intelligence and Machine Learning technologies
- Experience with cloud-based data platforms such as AWS and Azure
- Experience with agile development methodologies and version control systems such as Git
- Experience with data visualization tools such as Tableau and Cognos Analytics
- Familiarity with complex data regulatory requirements such as NIST 800-171 and SOX
- Familiarity with OpenTelemetry standards
- Optimization for observability data and real time anomaly detections