
Data Integration Engineer
- Miami, FL
- Contract
- Full-time
- Develop, Implement, and Support Data Integration Solutions: Design, build, and maintain robust data integration pipelines using batch, API, and data streaming technologies like Python, dbt, NiFi, Kafka, Striim, Fivetran, Informatica, Matillion, and SSIS; Ensure these solutions meet business requirements and integrate seamlessly with existing systems; Provide 24/7 on-call support in rotating schedules
- Data Warehouse Support: Work closely with the Data Warehouse team to implement data ingestion solutions ensuring efficient and reliable data availability from source systems
- Performance Monitoring and Optimization: Work closely with Ops and DevOps teams to improve the performance of data integrations, identify bottlenecks, and implement optimizations to ensure efficient data processing and movement
- Collaboration and Cross-Functional Support: Collaborate with Data DevOps & Ops teams to support the daily operation of the data integration platform; Work closely with the direct and indirect EDM leadership roles like Product and QA to align data strategies with organizational goals
- Data Quality and Compliance: Ensure the highest standards of data quality and compliance with relevant data governance and privacy policies
- Technical Innovation and Continuous Improvement: Stay abreast of emerging technologies and industry trends in data integration; Recommend and implement improvements to enhance system performance and data integration capabilities
- Perform other job-related functions as assigned
- Mid-to-advanced level experience in developing and implementing system integrations using database platforms (e.g., SQL Server, Oracle, Snowflake, Redshift, Hadoop)
- Experience in object oriented programming languages such as C# and Java, and scripting languages like Python and PowerShell
- Experience with technologies and standards such as Microsoft Message Queue, Kafka, IBM MQ, .NET, JSON, ASP.NET
- Familiarity with Agile SDLC. Ability to read, analyze and interpret common scientific and technical journals, financial reports, and legal documents
- Proven track record of: working in several organizational models such as matrixed resources
- Expertise in data analytics skill sets including data mining, regression analysis and data extraction
- Excellence in a variety of competencies including teamwork/collaboration, analytical thinking, communication and influencing skills, and technical expertise
- Excellent teamwork and interpersonal skills
- Respond to common inquiries or complaints from customers, regulatory agencies, or members of the business community
- Effectively present information to cross-functional teams and stakeholders
- Apply advanced mathematical concepts such as exponents, logarithms, quadratic equations, and permutations
- Apply mathematical operations to such tasks as frequency distribution, determination of test reliability and validity, analysis of variance, correlation techniques, sampling theory, and factor analysis
- Apply principles of logical or scientific thinking to a wide range of intellectual and practical problems
- Deal with nonverbal symbolism (formulas, scientific equations, graphs, musical notes, etc.,) in its most difficult phases
- Deal with a variety of abstract and concrete variables
- Communicate effectively with business users, members of IT, executive management and outside vendors