Principal Data Engineer

CoBank

  • Greenwood Village, CO
  • $10,000 per year
  • Permanent
  • Full-time
  • 17 days ago
Job DescriptionCoBank is looking for a Principal Data Engineer to join our Data Engineering (DE) team which is responsible for building and maintaining our data lake, ingestion and consumption data pipelines / services and facilitating the movement of large data each day. We work directly with business teams and platform and engineering teams to ensure growth strategies at CoBank. You are an out-of-the-box, structured thinker who is passionate about building services that scale. You will play a key role in providing the end-to-end data engineering solutions to support key business initiatives As a Principal Data Engineer at CoBank, you will play a pivotal role in driving the design, development, and optimization of our data infrastructure and architecture. You will lead the implementation of complex data engineering solutions, leveraging cloud-native technologies, particularly AWS services and open-source software. You will collaborate closely with cross-functional teams to ensure the successful delivery of data-driven initiatives aligned with the organization's strategic objectives. Collaborate with and across Agile teams to design, develop, test, implement, and support data engineering solutions in full-stack development tools and technologies. Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, mentoring other members of the engineering community.Essential Functions
  • Lead the design and implementation of highly scalable data pipelines and ETL processes.
  • Architect and optimize data storage and retrieval mechanisms, leveraging cloud-native solutions.
  • Drive data governance, quality, and metadata management initiatives.
  • Mentor junior engineers and promote innovation within the team.
  • Communicate effectively with stakeholders at all levels to ensure alignment on data initiatives.
Education
  • Bachelor's Degree in Computer Science, Information Technology, or related field. required
  • Bachelor's degree may be substituted with four years of related experience (four years is in addition to what is minimally required for the role), or an equivalent combination of education and related experience.
  • Master's Degree in Computer Science, Information Technology, or related field. preferred
Work Experience
  • 8 years of relevant experience in data engineering, with a proven track record of designing and implementing scalable data solutions, required
  • Prior Experience in a leadership or senior technical role within a data engineering team, required
  • Prior Experience with cloud platforms, particularly AWS, and proficiency in leveraging AWS native services for data processing, storage, and analytics, required
  • Prior Experience with other cloud platforms, such as Google Cloud Platform (GCP) or Microsoft Azure, preferred
  • Prior Experience with on-premises development environments, preferred
  • Prior Experience building self-service tooling and platforms, preferred
  • Prior Experience building and design of Data Mesh architecture platforms preferred
  • 1. Expertise in designing and implementing complex data pipelines and ETL processes, preferably using cloud-native technologies.
  • 2. In-depth knowledge of data architecture principles, including data modeling, schema design, and optimization techniques.
  • 3. Proficiency in programming languages commonly used in data engineering, such as Python, Scala, or Java.
  • 4. Strong understanding of distributed computing frameworks and big data technologies, such as Apache Spark, Hadoop, or Flink.
  • 5. Excellent problem-solving and analytical skills, with the ability to troubleshoot complex data engineering challenges.
  • 6. Effective communication and collaboration skills, with the ability to work cross-functionally and influence decision-making.
  • 7. Core Competencies:
  • - Expertise with AWS development environment and services
  • - Strategic thinking and planning.
  • - Continuous learning and innovation.
  • - Collaboration and teamwork.
  • - Results-driven mindset.
  • 8. Certifications in cloud computing or data engineering, particularly AWS certifications (preferred).
  • 9. Familiarity with containerization and orchestration technologies, such as Docker and Kubernetes (preferred).
  • 10. Knowledge of data governance frameworks and regulatory requirements, such as GDPR or CCPA (preferred).
  • 11. A passion for building and running continuous integration pipelines (preferred).
  • 12. Contributed to open-source projects (Ex: Operators in Airflow) (preferred).
About CoBankThe typical base pay range for this role is between $158,700 - $195,200. Compensation may vary based on individual job-related knowledge, skills, expertise, and experience. This position is eligible for a discretionary annual incentive program driven by organization and individual performance.The listed salary, other compensation and benefits information is accurate as of the date of this posting. This job will be posted for a minimum of five (5) business days or until the position is filled. CoBank reserves the right to adjust compensation for all positions and to modify or discontinue benefits programs at any time in its sole discretion, subject to applicable law.CoBank is a cooperative bank serving vital industries across rural America. The bank provides loans, leases, export financing and other financial services to agribusinesses and rural power, water and communications providers in all 50 states. The bank also provides wholesale loans and other financial services to affiliated Farm Credit associations serving more than 76,000 farmers, ranchers and other rural borrowers in 23 states around the country. CoBank is a member of the Farm Credit System, a nationwide network of banks and retail lending associations chartered to support the borrowing needs of U.S. agriculture, rural infrastructure and rural communities. Headquartered outside Denver, Colorado, CoBank serves customers from regional banking centers across the U.S. and also maintains an international representative office in Singapore.REASONABLE ACCOMMODATIONWe are committed to ensuring that our online application process provides an equal employment opportunity to all applicants, including qualified individuals with disabilities. If you are an applicant with a disability, or are assisting an applicant with a disability, and require accessibility assistance or would like to request a reasonable accommodation for any aspect of the application process, including completing an application, interviewing, or otherwise participating in the employee selection process, please submit a request by emailing recruiting@cobank.com. Include your contact information and specific details about your requested accommodation.Applicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over sponsorship of an employment visa at this time.CoBank is an Equal Opportunity Employer.All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, disability, or status as a protected veteran.

CoBank